2024-02-10T08:18:59.549 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-10T08:18:59.549 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321 --description rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} --name yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi -- /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/orig.config.yaml 2024-02-10T08:18:59.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T08:18:59.695 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321 branch: wip-yuri10-testing-2024-02-08-0854-pacific description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} email: null first_in_suite: false job_id: '7555321' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2024-02-08-0854-pacific ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(PG_AVAILABILITY\) sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 workunit: branch: wip-tracker-64343-pacific sha1: 57bd6abdec7bb457ae7999d9c96682e9ac678e27 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 964 sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-tracker-64343-pacific suite_path: /home/teuthworker/src/github.com_ljflores_ceph_57bd6abdec7bb457ae7999d9c96682e9ac678e27/qa suite_relpath: qa suite_repo: https://github.com/ljflores/ceph.git suite_sha1: 57bd6abdec7bb457ae7999d9c96682e9ac678e27 targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2//zw1hYkyCXHGSE7VHNTMsm6W9FRMxzNTim/XZiM9JTBIGnldn9QsvB5J2hWC0MBRcW+v6eJY+RPFEUv4g+A= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFr0rbtpN9nLzi1lIqSEQtLZGH34NCf0pDT9OIBHg5Rl/aYaA0cXWLNaQdyxcSPTz1+PHh3WttUOVeUhpayxCwk= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - cephadm: add_mons_via_daemon_add: true allow_ptrace: false avoid_pacific_features: true cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 --port=8000 - sleep 180 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch ps - ceph versions - ceph -s - ceph orch ls - ceph config set mgr container_image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph versions | jq -e '.mgr | length == 2' - ceph mgr fail - sleep 180 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph versions | jq -e '.mgr | length == 1' - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 2' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 1' - ceph versions | jq -e '.mon | keys' | grep $sha1 - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 5' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 7' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 8' - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 1' - ceph versions | jq -e '.osd | keys' | grep $sha1 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.r.z - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.rgw | length == 1' - ceph versions | jq -e '.rgw | keys' | grep $sha1 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-09_21:34:44 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-10T08:18:59.695 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ljflores_ceph_57bd6abdec7bb457ae7999d9c96682e9ac678e27/qa; will attempt to use it 2024-02-10T08:18:59.696 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ljflores_ceph_57bd6abdec7bb457ae7999d9c96682e9ac678e27/qa/tasks 2024-02-10T08:18:59.696 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-10T08:18:59.698 INFO:teuthology.task.internal:Checking packages... 2024-02-10T08:18:59.724 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0e714d9a4bd2a821113e6318adb87bd06cf81ec1' 2024-02-10T08:18:59.725 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-10T08:18:59.725 INFO:teuthology.packaging:ref: None 2024-02-10T08:18:59.725 INFO:teuthology.packaging:tag: None 2024-02-10T08:18:59.725 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-10T08:18:59.725 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:18:59.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-10T08:18:59.879 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-521.g0e714d9a 2024-02-10T08:18:59.880 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-10T08:18:59.891 INFO:teuthology.task.internal:no buildpackages task found 2024-02-10T08:18:59.892 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-10T08:18:59.993 INFO:teuthology.task.internal:Saving configuration 2024-02-10T08:19:00.016 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-10T08:19:00.022 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T08:19:00.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 08:13:23.770656', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2//zw1hYkyCXHGSE7VHNTMsm6W9FRMxzNTim/XZiM9JTBIGnldn9QsvB5J2hWC0MBRcW+v6eJY+RPFEUv4g+A='} 2024-02-10T08:19:00.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 08:13:23.772023', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFr0rbtpN9nLzi1lIqSEQtLZGH34NCf0pDT9OIBHg5Rl/aYaA0cXWLNaQdyxcSPTz1+PHh3WttUOVeUhpayxCwk='} 2024-02-10T08:19:00.074 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-10T08:19:00.081 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-02-10T08:19:00.081 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-02-10T08:19:00.081 INFO:teuthology.run_tasks:Running task console_log... 2024-02-10T08:19:00.163 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff6355230d0>, signals=[15]) 2024-02-10T08:19:00.163 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-10T08:19:00.169 INFO:teuthology.task.internal:Opening connections... 2024-02-10T08:19:00.169 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T08:19:00.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:19:00.256 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-02-10T08:19:00.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:19:00.334 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-10T08:19:00.340 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-02-10T08:19:00.364 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-02-10T08:19:00.365 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-02-10T08:19:00.427 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T08:19:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T08:19:00.429 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-02-10T08:19:00.462 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-02-10T08:19:00.485 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-02-10T08:19:00.485 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T08:19:00.547 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-02-10T08:19:00.548 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T08:19:00.548 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T08:19:00.548 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T08:19:00.548 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-10T08:19:00.569 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-10T08:19:00.578 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-10T08:19:00.583 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-10T08:19:00.583 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-02-10T08:19:00.586 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-02-10T08:19:00.607 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-10T08:19:00.614 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-10T08:19:00.614 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-02-10T08:19:00.649 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-02-10T08:19:00.681 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-10T08:19:00.737 INFO:teuthology.run_tasks:Running task kernel... 2024-02-10T08:19:00.760 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-10T08:19:00.760 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-10T08:19:00.761 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-10T08:19:00.761 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-10T08:19:00.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:19:00.781 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-02-10T08:19:00.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:19:00.783 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-02-10T08:19:00.842 INFO:teuthology.orchestra.run.smithi145.stdout:4.18.0-489.el8.x86_64 2024-02-10T08:19:00.842 INFO:teuthology.task.kernel:Running kernel on smithi145: 4.18.0-489.el8.x86_64 2024-02-10T08:19:00.842 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-02-10T08:19:00.845 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-489.el8.x86_64 2024-02-10T08:19:00.845 INFO:teuthology.task.kernel:Running kernel on smithi040: 4.18.0-489.el8.x86_64 2024-02-10T08:19:00.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-02-10T08:19:11.089 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 3.5 MB/s | 27 MB 00:07 2024-02-10T08:19:12.586 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - AppStream 2.9 MB/s | 27 MB 00:09 2024-02-10T08:19:21.364 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 2.0 MB/s | 10 MB 00:05 2024-02-10T08:19:22.268 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - BaseOS 2.1 MB/s | 10 MB 00:04 2024-02-10T08:19:23.380 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 56 kB/s | 18 kB 00:00 2024-02-10T08:19:23.839 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.9 kB 00:00 2024-02-10T08:19:24.099 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-02-10T08:19:24.168 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - Extras 59 kB/s | 18 kB 00:00 2024-02-10T08:19:24.610 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.9 kB 00:00 2024-02-10T08:19:24.829 INFO:teuthology.orchestra.run.smithi145.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-02-10T08:19:25.742 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2024-02-10T08:19:28.154 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 16 MB 00:03 2024-02-10T08:19:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 414 kB/s | 24 kB 00:00 2024-02-10T08:19:31.904 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 553 kB/s | 24 kB 00:00 2024-02-10T08:19:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-10T08:19:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-10T08:19:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-02-10T08:19:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-02-10T08:19:33.025 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-02-10T08:19:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-02-10T08:19:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-02-10T08:19:33.025 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:Install 3 Packages 2024-02-10T08:19:33.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:19:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 90 M 2024-02-10T08:19:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 96 M 2024-02-10T08:19:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-02-10T08:19:34.831 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-10T08:19:34.831 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-10T08:19:34.960 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-02-10T08:19:34.961 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-02-10T08:19:34.962 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-02-10T08:19:34.962 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-02-10T08:19:34.962 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-02-10T08:19:34.962 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 4.18.0-536.el8 baseos 10 M 2024-02-10T08:19:34.962 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-02-10T08:19:34.962 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 4.18.0-536.el8 baseos 44 M 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 4.18.0-536.el8 baseos 36 M 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi145.stdout:Install 3 Packages 2024-02-10T08:19:34.963 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:19:34.964 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 90 M 2024-02-10T08:19:34.964 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 96 M 2024-02-10T08:19:34.964 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-02-10T08:19:38.485 INFO:teuthology.orchestra.run.smithi040.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 1.9 MB/s | 10 MB 00:05 2024-02-10T08:19:40.472 INFO:teuthology.orchestra.run.smithi145.stdout:(1/3): kernel-4.18.0-536.el8.x86_64.rpm 1.9 MB/s | 10 MB 00:05 2024-02-10T08:19:47.726 INFO:teuthology.orchestra.run.smithi040.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 2.5 MB/s | 36 MB 00:14 2024-02-10T08:19:48.862 INFO:teuthology.orchestra.run.smithi145.stdout:(2/3): kernel-modules-4.18.0-536.el8.x86_64.rpm 2.6 MB/s | 36 MB 00:13 2024-02-10T08:19:53.250 INFO:teuthology.orchestra.run.smithi040.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 2.2 MB/s | 44 MB 00:20 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:19:53.251 INFO:teuthology.orchestra.run.smithi040.stdout:Total 4.5 MB/s | 90 MB 00:20 2024-02-10T08:19:53.961 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-02-10T08:19:54.410 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-02-10T08:19:54.411 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-02-10T08:19:55.728 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-02-10T08:19:55.758 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-02-10T08:19:57.411 INFO:teuthology.orchestra.run.smithi145.stdout:(3/3): kernel-core-4.18.0-536.el8.x86_64.rpm 2.0 MB/s | 44 MB 00:22 2024-02-10T08:19:57.452 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:19:57.452 INFO:teuthology.orchestra.run.smithi145.stdout:Total 4.0 MB/s | 90 MB 00:22 2024-02-10T08:19:58.093 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-02-10T08:19:58.531 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-02-10T08:19:58.531 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-02-10T08:19:58.692 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-02-10T08:19:59.209 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-02-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-02-10T08:20:02.639 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-02-10T08:20:02.968 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T08:20:03.127 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T08:20:03.384 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T08:20:06.675 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 1/3 2024-02-10T08:20:07.067 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T08:20:07.084 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T08:20:07.327 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:10.518 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 2/3 2024-02-10T08:20:10.798 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:31.110 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:31.135 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:31.487 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:31.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-10T08:20:31.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:20:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-02-10T08:20:32.192 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T08:20:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T08:20:32.420 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T08:20:32.420 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-10T08:20:32.420 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-10T08:20:32.421 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-10T08:20:32.421 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-10T08:20:32.421 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-02-10T08:20:32.421 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T08:20:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T08:20:32.641 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T08:20:32.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-02-10T08:20:32.658 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.02 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 129.el8 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Group : System Environment/Base 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 9265586 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-10T08:20:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:Relocations : (not relocatable) 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : CentOS BuildSystem 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:20:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-02-10T08:20:32.679 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-10T08:20:32.679 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 4.18.0-536.el8.x86_64 2024-02-10T08:20:32.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-10T08:20:32.682 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:33.029 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:33.029 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-4.18.0-536.el8.x86_64 1/3 2024-02-10T08:20:33.030 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-4.18.0-536.el8.x86_64 2/3 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-4.18.0-536.el8.x86_64 3/3 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-4.18.0-536.el8.x86_64 kernel-core-4.18.0-536.el8.x86_64 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-4.18.0-536.el8.x86_64 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:20:33.544 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-02-10T08:20:33.686 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T08:20:33.903 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T08:20:33.903 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T08:20:33.903 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-536.el8.x86_64 2024-02-10T08:20:33.903 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-10T08:20:33.904 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-10T08:20:33.904 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-10T08:20:33.904 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-02-10T08:20:33.904 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-02-10T08:20:34.038 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-02-10T08:20:34.115 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-4.18.0-536.el8.x86_64 2024-02-10T08:20:34.115 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-536.el8.x86_64 2024-02-10T08:20:34.116 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-02-10T08:20:34.149 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-02-10T08:20:34.149 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-02-10T08:20:34.149 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.02 2024-02-10T08:20:34.149 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 129.el8 2024-02-10T08:20:34.149 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-02-10T08:20:34.149 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Group : System Environment/Base 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 9265586 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Relocations : (not relocatable) 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : CentOS BuildSystem 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-02-10T08:20:34.150 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:20:34.151 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-02-10T08:20:34.152 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-10T08:20:34.152 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 4.18.0-536.el8.x86_64 2024-02-10T08:20:34.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-10T08:20:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-02-10T08:20:35.807 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-02-10T08:20:35.850 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.VXbpCh6dFx 2024-02-10T08:20:35.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VXbpCh6dFx 2024-02-10T08:20:35.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.VXbpCh6dFx 2024-02-10T08:20:35.961 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-02-10T08:20:36.069 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.VXbpCh6dFx is 6KB 2024-02-10T08:20:36.117 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.VXbpCh6dFx 2024-02-10T08:20:36.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-02-10T08:20:36.210 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-10T08:20:36.210 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-10T08:20:36.210 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-10T08:20:36.210 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-10T08:20:36.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-10T08:20:36.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-02-10T08:20:37.809 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-02-10T08:20:37.810 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-02-10T08:20:37.841 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.3qmHkcnqmE 2024-02-10T08:20:37.842 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3qmHkcnqmE 2024-02-10T08:20:37.916 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.3qmHkcnqmE 2024-02-10T08:20:38.062 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.3qmHkcnqmE is 6KB 2024-02-10T08:20:38.110 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.3qmHkcnqmE 2024-02-10T08:20:38.128 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-02-10T08:20:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-10T08:20:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-10T08:20:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-10T08:20:38.200 INFO:teuthology.orchestra.run.smithi145.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64.conf 2024-02-10T08:20:38.201 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-536.el8.x86_64 2024-02-10T08:20:38.371 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-02-10T08:21:06.416 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-10T08:21:06.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-10T08:21:06.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:21:08.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-10T08:21:08.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-10T08:21:08.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:21:24.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-02-10T08:21:26.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-10T08:21:33.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-10T08:21:33.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:21:35.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-10T08:21:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:21:38.780 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-10T08:21:50.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-10T08:21:50.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:22:23.342 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-02-10T08:22:24.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-10T08:22:24.201 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-536.el8.x86_64"... 2024-02-10T08:22:24.202 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-02-10T08:22:24.263 INFO:teuthology.orchestra.run.smithi145.stdout:4.18.0-536.el8.x86_64 2024-02-10T08:22:24.263 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-10T08:22:24.263 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-10T08:22:24.263 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-10T08:22:25.264 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-10T08:22:25.264 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-10T08:22:25.341 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-02-10T08:22:25.356 DEBUG:teuthology.parallel:result is None 2024-02-10T08:22:33.936 DEBUG:teuthology.orchestra.remote:timed out 2024-02-10T08:22:45.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-10T08:22:45.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:22:46.225 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-02-10T08:22:46.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-10T08:22:46.524 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-536.el8.x86_64"... 2024-02-10T08:22:46.525 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-02-10T08:22:46.544 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-536.el8.x86_64 2024-02-10T08:22:46.544 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-536.el8.x86_64 vs 4.18.0-536.el8.x86_64 2024-02-10T08:22:46.544 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-10T08:22:46.544 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-10T08:22:47.545 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-10T08:22:47.545 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-10T08:22:47.637 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-02-10T08:22:47.651 DEBUG:teuthology.parallel:result is None 2024-02-10T08:22:47.651 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-10T08:22:47.663 INFO:teuthology.task.internal:Creating test directory... 2024-02-10T08:22:47.663 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-10T08:22:47.666 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-10T08:22:47.688 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-10T08:22:47.694 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-10T08:22:47.705 INFO:teuthology.task.internal:Creating archive directory... 2024-02-10T08:22:47.705 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-10T08:22:47.728 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-10T08:22:47.776 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-10T08:22:47.782 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-10T08:22:47.783 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-10T08:22:47.785 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-10T08:22:47.820 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:22:47.832 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:22:47.847 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:22:47.858 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-10T08:22:47.859 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-10T08:22:47.867 INFO:teuthology.task.internal:Configuring sudo... 2024-02-10T08:22:47.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-10T08:22:47.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-10T08:22:47.931 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-10T08:22:47.941 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-10T08:22:47.941 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-10T08:22:47.947 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-10T08:22:47.991 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:22:48.052 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:22:48.103 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:22:48.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:22:48.234 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:22:48.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-10T08:22:48.302 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:22:48.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-10T08:22:48.404 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:22:48.491 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-10T08:22:48.535 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:22:48.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-10T08:22:48.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-02-10T08:22:48.607 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-02-10T08:22:48.672 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T08:22:48.737 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T08:22:49.044 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-10T08:22:49.054 INFO:teuthology.task.internal:Starting timer... 2024-02-10T08:22:49.055 INFO:teuthology.run_tasks:Running task pcp... 2024-02-10T08:22:49.068 INFO:teuthology.run_tasks:Running task selinux... 2024-02-10T08:22:49.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-02-10T08:22:49.167 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-02-10T08:22:49.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-02-10T08:22:49.257 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-02-10T08:22:49.259 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-10T08:22:49.259 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-02-10T08:22:49.328 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-02-10T08:22:49.328 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-02-10T08:22:49.380 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-02-10T08:22:49.381 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-02-10T08:22:49.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T08:22:49.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:22:49.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T08:22:49.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T08:22:49.442 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-10T08:22:49.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-02-10T08:22:49.484 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-02-10T08:22:49.512 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-10T08:22:49.523 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-10T08:22:49.530 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-10T08:22:49.657 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-10T08:22:49.673 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-10T08:22:49.674 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-10T08:29:06.034 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-02-10T08:29:06.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-10T08:29:06.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:29:06.113 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-02-10T08:29:06.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-02-10T08:29:06.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-10T08:29:06.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T08:29:06.254 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-02-10T08:29:06.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-10T08:29:06.321 INFO:teuthology.run_tasks:Running task clock... 2024-02-10T08:29:06.332 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-10T08:29:06.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-10T08:29:06.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T08:29:06.335 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-10T08:29:06.335 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T08:29:06.369 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-10T08:29:06.385 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-10T08:29:06.392 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-10T08:29:06.406 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-10T08:29:06.452 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-02-10T08:29:06.464 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-02-10T08:29:06.473 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-02-10T08:29:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-10T08:29:06.483 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-02-10T08:29:06.492 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-10T08:29:06.497 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-10T08:29:06.510 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-10T08:29:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2024-02-10T08:29:06.562 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T08:29:06.562 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-02-10T08:29:06.562 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.562 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.562 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.563 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.578 INFO:teuthology.orchestra.run.smithi145.stderr:bash: ntpq: command not found 2024-02-10T08:29:06.583 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T08:29:06.583 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-02-10T08:29:06.583 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.583 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.583 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.583 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T08:29:06.583 INFO:teuthology.run_tasks:Running task pexec... 2024-02-10T08:29:06.592 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-10T08:29:06.593 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T08:29:06.593 DEBUG:teuthology.orchestra.run.smithi040:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-10T08:29:06.593 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi145.front.sepia.ceph.com 2024-02-10T08:29:06.593 DEBUG:teuthology.orchestra.run.smithi145:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-10T08:29:07.409 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:44 ago on Sat 10 Feb 2024 08:27:23 AM UTC. 2024-02-10T08:29:07.421 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:33 ago on Sat 10 Feb 2024 08:27:34 AM UTC. 2024-02-10T08:29:09.408 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout:Resetting modules: 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout: container-tools 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-02-10T08:29:09.409 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-02-10T08:29:09.410 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:29:09.534 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-02-10T08:29:09.535 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout:Resetting modules: 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout: container-tools 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-02-10T08:29:09.536 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:29:09.662 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-02-10T08:29:09.836 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-02-10T08:29:10.514 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:47 ago on Sat 10 Feb 2024 08:27:23 AM UTC. 2024-02-10T08:29:10.745 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:36 ago on Sat 10 Feb 2024 08:27:34 AM UTC. 2024-02-10T08:29:12.507 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout:=========================================================================================== 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout:=========================================================================================== 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout: conmon x86_64 3:2.1.10-1.module_el8+804+f131391c appstream 58 k 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout: container-selinux noarch 2:2.227.0-1.module_el8+804+f131391c appstream 70 k 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout: containernetworking-plugins x86_64 1:1.4.0-1.module_el8+804+f131391c appstream 22 M 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout: containers-common x86_64 2:1-58.module_el8+804+f131391c appstream 148 k 2024-02-10T08:29:12.510 INFO:teuthology.orchestra.run.smithi145.stdout: criu x86_64 3.18-4.module_el8+804+f131391c appstream 564 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-overlayfs x86_64 1.13-1.module_el8+804+f131391c appstream 70 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: libslirp x86_64 4.4.0-1.module_el8+804+f131391c appstream 70 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: runc x86_64 1:1.1.11-1.module_el8+804+f131391c appstream 3.1 M 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: slirp4netns x86_64 1.2.2-1.module_el8+804+f131391c appstream 56 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout:Installing group/module packages: 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: aardvark-dns x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 1.0 M 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: buildah x86_64 1:1.34.0-1.module_el8+804+f131391c appstream 9.7 M 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: cockpit-podman noarch 82-1.module_el8+804+f131391c appstream 759 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: crun x86_64 1.12-1.module_el8+804+f131391c appstream 248 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: netavark x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 4.0 M 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: python3-podman noarch 4.8.2-1.module_el8+804+f131391c appstream 179 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: skopeo x86_64 2:1.14.0-2.module_el8+804+f131391c appstream 8.8 M 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: toolbox x86_64 0.0.99.4-8.module_el8+804+f131391c appstream 2.5 M 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-10T08:29:12.511 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: criu-libs x86_64 3.18-4.module_el8+804+f131391c appstream 39 k 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:Installing module profiles: 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: container-tools/common 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:Enabling module streams: 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: container-tools rhel8 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:=========================================================================================== 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:Install 13 Packages 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 9 Packages 2024-02-10T08:29:12.512 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:29:12.513 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 54 M 2024-02-10T08:29:12.513 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-02-10T08:29:12.861 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-02-10T08:29:12.864 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2024-02-10T08:29:12.864 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2024-02-10T08:29:12.864 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2024-02-10T08:29:12.864 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: conmon x86_64 3:2.1.10-1.module_el8+804+f131391c appstream 58 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: container-selinux noarch 2:2.227.0-1.module_el8+804+f131391c appstream 70 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: containernetworking-plugins x86_64 1:1.4.0-1.module_el8+804+f131391c appstream 22 M 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: containers-common x86_64 2:1-58.module_el8+804+f131391c appstream 148 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: criu x86_64 3.18-4.module_el8+804+f131391c appstream 564 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-overlayfs x86_64 1.13-1.module_el8+804+f131391c appstream 70 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: libslirp x86_64 4.4.0-1.module_el8+804+f131391c appstream 70 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: runc x86_64 1:1.1.11-1.module_el8+804+f131391c appstream 3.1 M 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: slirp4netns x86_64 1.2.2-1.module_el8+804+f131391c appstream 56 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout:Installing group/module packages: 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: aardvark-dns x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 1.0 M 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: buildah x86_64 1:1.34.0-1.module_el8+804+f131391c appstream 9.7 M 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: cockpit-podman noarch 82-1.module_el8+804+f131391c appstream 759 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: crun x86_64 1.12-1.module_el8+804+f131391c appstream 248 k 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: netavark x86_64 2:1.9.0-1.module_el8+804+f131391c appstream 4.0 M 2024-02-10T08:29:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: python3-podman noarch 4.8.2-1.module_el8+804+f131391c appstream 179 k 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: skopeo x86_64 2:1.14.0-2.module_el8+804+f131391c appstream 8.8 M 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: toolbox x86_64 0.0.99.4-8.module_el8+804+f131391c appstream 2.5 M 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: criu-libs x86_64 3.18-4.module_el8+804+f131391c appstream 39 k 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout:Installing module profiles: 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: container-tools/common 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling module streams: 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: container-tools rhel8 2024-02-10T08:29:12.866 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout:Install 13 Packages 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 9 Packages 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 54 M 2024-02-10T08:29:12.867 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-02-10T08:29:13.364 INFO:teuthology.orchestra.run.smithi145.stdout:(1/22): cockpit-podman-82-1.module_el8+804+f131 939 kB/s | 759 kB 00:00 2024-02-10T08:29:13.431 INFO:teuthology.orchestra.run.smithi145.stdout:(2/22): aardvark-dns-1.9.0-1.module_el8+804+f13 1.1 MB/s | 1.0 MB 00:00 2024-02-10T08:29:13.515 INFO:teuthology.orchestra.run.smithi145.stdout:(3/22): criu-libs-3.18-4.module_el8+804+f131391 261 kB/s | 39 kB 00:00 2024-02-10T08:29:13.573 INFO:teuthology.orchestra.run.smithi145.stdout:(4/22): crun-1.12-1.module_el8+804+f131391c.x86 1.7 MB/s | 248 kB 00:00 2024-02-10T08:29:13.682 INFO:teuthology.orchestra.run.smithi145.stdout:(5/22): python3-podman-4.8.2-1.module_el8+804+f 1.6 MB/s | 179 kB 00:00 2024-02-10T08:29:13.849 INFO:teuthology.orchestra.run.smithi145.stdout:(6/22): python3-pytoml-0.1.14-5.git7dea353.el8. 148 kB/s | 25 kB 00:00 2024-02-10T08:29:14.057 INFO:teuthology.orchestra.run.smithi145.stdout:(7/22): python3-pyxdg-0.25-16.el8.noarch.rpm 450 kB/s | 94 kB 00:00 2024-02-10T08:29:14.749 INFO:teuthology.orchestra.run.smithi040.stdout:(1/22): cockpit-podman-82-1.module_el8+804+f131 448 kB/s | 759 kB 00:01 2024-02-10T08:29:14.908 INFO:teuthology.orchestra.run.smithi040.stdout:(2/22): criu-libs-3.18-4.module_el8+804+f131391 248 kB/s | 39 kB 00:00 2024-02-10T08:29:15.367 INFO:teuthology.orchestra.run.smithi040.stdout:(3/22): crun-1.12-1.module_el8+804+f131391c.x86 542 kB/s | 248 kB 00:00 2024-02-10T08:29:15.999 INFO:teuthology.orchestra.run.smithi145.stdout:(8/22): netavark-1.9.0-1.module_el8+804+f131391 1.6 MB/s | 4.0 MB 00:02 2024-02-10T08:29:16.058 INFO:teuthology.orchestra.run.smithi040.stdout:(4/22): aardvark-dns-1.9.0-1.module_el8+804+f13 343 kB/s | 1.0 MB 00:03 2024-02-10T08:29:16.292 INFO:teuthology.orchestra.run.smithi040.stdout:(5/22): python3-podman-4.8.2-1.module_el8+804+f 770 kB/s | 179 kB 00:00 2024-02-10T08:29:16.426 INFO:teuthology.orchestra.run.smithi040.stdout:(6/22): python3-pytoml-0.1.14-5.git7dea353.el8. 186 kB/s | 25 kB 00:00 2024-02-10T08:29:16.559 INFO:teuthology.orchestra.run.smithi040.stdout:(7/22): python3-pyxdg-0.25-16.el8.noarch.rpm 704 kB/s | 94 kB 00:00 2024-02-10T08:29:17.316 INFO:teuthology.orchestra.run.smithi145.stdout:(9/22): toolbox-0.0.99.4-8.module_el8+804+f1313 1.9 MB/s | 2.5 MB 00:01 2024-02-10T08:29:17.708 INFO:teuthology.orchestra.run.smithi145.stdout:(10/22): udica-0.2.6-20.module_el8+804+f131391c 134 kB/s | 53 kB 00:00 2024-02-10T08:29:17.884 INFO:teuthology.orchestra.run.smithi145.stdout:(11/22): skopeo-1.14.0-2.module_el8+804+f131391 2.3 MB/s | 8.8 MB 00:03 2024-02-10T08:29:17.992 INFO:teuthology.orchestra.run.smithi145.stdout:(12/22): yajl-2.1.0-12.el8.x86_64.rpm 144 kB/s | 41 kB 00:00 2024-02-10T08:29:18.184 INFO:teuthology.orchestra.run.smithi145.stdout:(13/22): conmon-2.1.10-1.module_el8+804+f131391 193 kB/s | 58 kB 00:00 2024-02-10T08:29:18.293 INFO:teuthology.orchestra.run.smithi145.stdout:(14/22): buildah-1.34.0-1.module_el8+804+f13139 1.7 MB/s | 9.7 MB 00:05 2024-02-10T08:29:18.326 INFO:teuthology.orchestra.run.smithi145.stdout:(15/22): container-selinux-2.227.0-1.module_el8 211 kB/s | 70 kB 00:00 2024-02-10T08:29:18.602 INFO:teuthology.orchestra.run.smithi145.stdout:(16/22): containers-common-1-58.module_el8+804+ 479 kB/s | 148 kB 00:00 2024-02-10T08:29:18.635 INFO:teuthology.orchestra.run.smithi145.stdout:(17/22): criu-3.18-4.module_el8+804+f131391c.x8 1.8 MB/s | 564 kB 00:00 2024-02-10T08:29:18.886 INFO:teuthology.orchestra.run.smithi145.stdout:(18/22): fuse-overlayfs-1.13-1.module_el8+804+f 247 kB/s | 70 kB 00:00 2024-02-10T08:29:18.928 INFO:teuthology.orchestra.run.smithi145.stdout:(19/22): libslirp-4.4.0-1.module_el8+804+f13139 241 kB/s | 70 kB 00:00 2024-02-10T08:29:19.010 INFO:teuthology.orchestra.run.smithi040.stdout:(8/22): buildah-1.34.0-1.module_el8+804+f131391 1.6 MB/s | 9.7 MB 00:05 2024-02-10T08:29:19.428 INFO:teuthology.orchestra.run.smithi145.stdout:(20/22): slirp4netns-1.2.2-1.module_el8+804+f13 112 kB/s | 56 kB 00:00 2024-02-10T08:29:20.210 INFO:teuthology.orchestra.run.smithi040.stdout:(9/22): netavark-1.9.0-1.module_el8+804+f131391 836 kB/s | 4.0 MB 00:04 2024-02-10T08:29:20.278 INFO:teuthology.orchestra.run.smithi145.stdout:(21/22): runc-1.1.11-1.module_el8+804+f131391c. 2.3 MB/s | 3.1 MB 00:01 2024-02-10T08:29:20.285 INFO:teuthology.orchestra.run.smithi040.stdout:(10/22): toolbox-0.0.99.4-8.module_el8+804+f131 2.0 MB/s | 2.5 MB 00:01 2024-02-10T08:29:20.352 INFO:teuthology.orchestra.run.smithi040.stdout:(11/22): udica-0.2.6-20.module_el8+804+f131391c 371 kB/s | 53 kB 00:00 2024-02-10T08:29:20.461 INFO:teuthology.orchestra.run.smithi040.stdout:(12/22): yajl-2.1.0-12.el8.x86_64.rpm 233 kB/s | 41 kB 00:00 2024-02-10T08:29:20.494 INFO:teuthology.orchestra.run.smithi040.stdout:(13/22): conmon-2.1.10-1.module_el8+804+f131391 409 kB/s | 58 kB 00:00 2024-02-10T08:29:20.586 INFO:teuthology.orchestra.run.smithi040.stdout:(14/22): container-selinux-2.227.0-1.module_el8 562 kB/s | 70 kB 00:00 2024-02-10T08:29:20.811 INFO:teuthology.orchestra.run.smithi040.stdout:(15/22): containers-common-1-58.module_el8+804+ 657 kB/s | 148 kB 00:00 2024-02-10T08:29:21.045 INFO:teuthology.orchestra.run.smithi040.stdout:(16/22): criu-3.18-4.module_el8+804+f131391c.x8 2.4 MB/s | 564 kB 00:00 2024-02-10T08:29:21.162 INFO:teuthology.orchestra.run.smithi040.stdout:(17/22): fuse-overlayfs-1.13-1.module_el8+804+f 600 kB/s | 70 kB 00:00 2024-02-10T08:29:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:(18/22): libslirp-4.4.0-1.module_el8+804+f13139 603 kB/s | 70 kB 00:00 2024-02-10T08:29:22.154 INFO:teuthology.orchestra.run.smithi040.stdout:(19/22): runc-1.1.11-1.module_el8+804+f131391c. 3.6 MB/s | 3.1 MB 00:00 2024-02-10T08:29:22.279 INFO:teuthology.orchestra.run.smithi040.stdout:(20/22): slirp4netns-1.2.2-1.module_el8+804+f13 447 kB/s | 56 kB 00:00 2024-02-10T08:29:26.170 INFO:teuthology.orchestra.run.smithi145.stdout:(22/22): containernetworking-plugins-1.4.0-1.mo 2.8 MB/s | 22 MB 00:07 2024-02-10T08:29:26.170 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:29:26.170 INFO:teuthology.orchestra.run.smithi145.stdout:Total 3.9 MB/s | 54 MB 00:13 2024-02-10T08:29:26.670 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-02-10T08:29:26.714 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-02-10T08:29:26.714 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-02-10T08:29:27.209 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-02-10T08:29:27.212 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-02-10T08:29:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:(21/22): skopeo-1.14.0-2.module_el8+804+f131391 827 kB/s | 8.8 MB 00:10 2024-02-10T08:29:28.513 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-02-10T08:29:28.526 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f131391 1/1 2024-02-10T08:29:28.568 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f1313 1/31 2024-02-10T08:29:28.803 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : container-selinux-2:2.227.0-1.module_el8+804+f1313 1/31 2024-02-10T08:29:34.872 INFO:teuthology.orchestra.run.smithi040.stdout:(22/22): containernetworking-plugins-1.4.0-1.mo 1.5 MB/s | 22 MB 00:14 2024-02-10T08:29:34.872 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-02-10T08:29:34.872 INFO:teuthology.orchestra.run.smithi040.stdout:Total 2.4 MB/s | 54 MB 00:22 2024-02-10T08:29:35.381 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-02-10T08:29:35.430 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-02-10T08:29:35.430 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-02-10T08:29:35.940 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-02-10T08:29:35.943 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-02-10T08:29:37.345 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-02-10T08:29:37.358 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f131391 1/1 2024-02-10T08:29:37.395 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f1313 1/31 2024-02-10T08:29:37.666 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : container-selinux-2:2.227.0-1.module_el8+804+f1313 1/31 2024-02-10T08:29:46.743 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f1313 1/31 2024-02-10T08:29:47.287 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : criu-3.18-4.module_el8+804+f131391c.x86_64 2/31 2024-02-10T08:29:47.506 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : runc-1:1.1.11-1.module_el8+804+f131391c.x86_64 3/31 2024-02-10T08:29:47.658 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-10T08:29:47.856 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 5/31 2024-02-10T08:29:48.108 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 6/31 2024-02-10T08:29:48.299 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-10T08:29:50.121 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-10T08:29:50.390 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : containernetworking-plugins-1:1.4.0-1.module_el8+8 8/31 2024-02-10T08:29:50.602 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : yajl-2.1.0-12.el8.x86_64 9/31 2024-02-10T08:29:50.807 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : crun-1.12-1.module_el8+804+f131391c.x86_64 10/31 2024-02-10T08:29:51.060 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : containers-common-2:1-58.module_el8+804+f131391c.x 11/31 2024-02-10T08:29:51.223 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/31 2024-02-10T08:29:51.549 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 13/31 2024-02-10T08:29:52.122 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 14/31 2024-02-10T08:29:53.089 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 15/31 2024-02-10T08:29:53.376 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 16/31 2024-02-10T08:29:54.332 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 17/31 2024-02-10T08:29:54.760 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 18/31 2024-02-10T08:29:54.943 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 19/31 2024-02-10T08:29:55.138 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 20/31 2024-02-10T08:29:55.392 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 21/31 2024-02-10T08:29:55.557 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cockpit-podman-82-1.module_el8+804+f131391c.noarch 22/31 2024-02-10T08:29:55.753 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2024-02-10T08:29:55.933 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2024-02-10T08:29:56.141 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2024-02-10T08:29:56.141 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-10T08:29:56.332 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-10T08:29:56.473 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f1313 1/31 2024-02-10T08:29:56.569 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2024-02-10T08:29:56.824 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2024-02-10T08:29:57.035 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2024-02-10T08:29:57.074 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : criu-3.18-4.module_el8+804+f131391c.x86_64 2/31 2024-02-10T08:29:57.274 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2024-02-10T08:29:57.314 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : runc-1:1.1.11-1.module_el8+804+f131391c.x86_64 3/31 2024-02-10T08:29:57.488 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-10T08:29:57.489 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-10T08:29:57.679 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 5/31 2024-02-10T08:29:57.962 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 6/31 2024-02-10T08:29:58.130 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-10T08:30:00.126 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-10T08:30:00.383 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : containernetworking-plugins-1:1.4.0-1.module_el8+8 8/31 2024-02-10T08:30:00.601 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : yajl-2.1.0-12.el8.x86_64 9/31 2024-02-10T08:30:00.824 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : crun-1.12-1.module_el8+804+f131391c.x86_64 10/31 2024-02-10T08:30:01.103 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : containers-common-2:1-58.module_el8+804+f131391c.x 11/31 2024-02-10T08:30:01.322 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 12/31 2024-02-10T08:30:01.639 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 13/31 2024-02-10T08:30:02.252 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 14/31 2024-02-10T08:30:03.316 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 15/31 2024-02-10T08:30:03.657 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 16/31 2024-02-10T08:30:04.704 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 17/31 2024-02-10T08:30:05.128 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 18/31 2024-02-10T08:30:05.358 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 19/31 2024-02-10T08:30:05.570 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 20/31 2024-02-10T08:30:05.839 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 21/31 2024-02-10T08:30:06.047 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cockpit-podman-82-1.module_el8+804+f131391c.noarch 22/31 2024-02-10T08:30:06.245 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2024-02-10T08:30:06.480 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2024-02-10T08:30:06.696 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2024-02-10T08:30:06.697 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-10T08:30:06.908 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-10T08:30:07.096 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2024-02-10T08:30:07.283 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2024-02-10T08:30:07.473 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2024-02-10T08:30:07.713 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2024-02-10T08:30:07.895 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-10T08:30:17.060 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f1313 31/31 2024-02-10T08:30:17.527 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-10T08:30:17.527 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 1/31 2024-02-10T08:30:17.527 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cockpit-podman-82-1.module_el8+804+f131391c.noarch 3/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : crun-1.12-1.module_el8+804+f131391c.x86_64 5/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 6/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 7/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 10/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 11/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 14/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : container-selinux-2:2.227.0-1.module_el8+804+f1313 16/31 2024-02-10T08:30:17.528 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : containernetworking-plugins-1:1.4.0-1.module_el8+8 18/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : containers-common-2:1-58.module_el8+804+f131391c.x 20/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : criu-3.18-4.module_el8+804+f131391c.x86_64 22/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 24/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 26/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : runc-1:1.1.11-1.module_el8+804+f131391c.x86_64 28/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2024-02-10T08:30:17.529 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 30/31 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: container-selinux-2:2.227.0-1.module_el8+804+f131391c.noarch 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: containernetworking-plugins-1:1.4.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: containers-common-2:1-58.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: criu-3.18-4.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.232 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: runc-1:1.1.11-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: cockpit-podman-82-1.module_el8+804+f131391c.noarch 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: criu-libs-3.18-4.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: crun-1.12-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: python3-podman-4.8.2-1.module_el8+804+f131391c.noarch 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-10T08:30:18.233 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:30:18.234 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-02-10T08:30:18.528 DEBUG:teuthology.parallel:result is None 2024-02-10T08:30:28.810 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: container-selinux-2:2.227.0-1.module_el8+804+f1313 31/31 2024-02-10T08:30:29.279 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-10T08:30:29.279 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86 1/31 2024-02-10T08:30:29.279 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2/31 2024-02-10T08:30:29.279 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cockpit-podman-82-1.module_el8+804+f131391c.noarch 3/31 2024-02-10T08:30:29.280 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-10T08:30:29.280 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : crun-1.12-1.module_el8+804+f131391c.x86_64 5/31 2024-02-10T08:30:29.280 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 6/31 2024-02-10T08:30:29.280 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-podman-4.8.2-1.module_el8+804+f131391c.noa 7/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 10/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 11/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 14/31 2024-02-10T08:30:29.283 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : container-selinux-2:2.227.0-1.module_el8+804+f1313 16/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : containernetworking-plugins-1:1.4.0-1.module_el8+8 18/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : containers-common-2:1-58.module_el8+804+f131391c.x 20/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : criu-3.18-4.module_el8+804+f131391c.x86_64 22/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 24/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 26/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : runc-1:1.1.11-1.module_el8+804+f131391c.x86_64 28/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2024-02-10T08:30:29.284 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 30/31 2024-02-10T08:30:30.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2024-02-10T08:30:30.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:30:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: container-selinux-2:2.227.0-1.module_el8+804+f131391c.noarch 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: containernetworking-plugins-1:1.4.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: containers-common-2:1-58.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: criu-3.18-4.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: runc-1:1.1.11-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: aardvark-dns-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: buildah-1:1.34.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: cockpit-podman-82-1.module_el8+804+f131391c.noarch 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: criu-libs-3.18-4.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: crun-1.12-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: netavark-2:1.9.0-1.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-podman-4.8.2-1.module_el8+804+f131391c.noarch 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: skopeo-2:1.14.0-2.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: toolbox-0.0.99.4-8.module_el8+804+f131391c.x86_64 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:30:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-02-10T08:30:30.363 DEBUG:teuthology.parallel:result is None 2024-02-10T08:30:30.363 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-10T08:30:30.439 INFO:tasks.cephadm:Config: {'add_mons_via_daemon_add': True, 'allow_ptrace': False, 'avoid_pacific_features': True, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(PG_AVAILABILITY\\)'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-10T08:30:30.439 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2024-02-10T08:30:30.440 INFO:tasks.cephadm:Cluster fsid is a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:30:30.440 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-10T08:30:30.440 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.40', 'mon.c': '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]', 'mon.b': '172.21.15.145'} 2024-02-10T08:30:30.440 INFO:tasks.cephadm:First mon is mon.a on smithi040 2024-02-10T08:30:30.440 INFO:tasks.cephadm:First mgr is y 2024-02-10T08:30:30.440 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-10T08:30:30.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname $(hostname -s) 2024-02-10T08:30:30.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname $(hostname -s) 2024-02-10T08:30:30.504 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2024-02-10T08:30:30.505 DEBUG:teuthology.orchestra.run.smithi040:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-10T08:30:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Feb 10 08:30 /home/ubuntu/cephtest/cephadm 2024-02-10T08:30:30.798 DEBUG:teuthology.orchestra.run.smithi145:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-10T08:30:30.927 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Feb 10 08:30 /home/ubuntu/cephtest/cephadm 2024-02-10T08:30:30.927 DEBUG:teuthology.orchestra.run.smithi040:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-10T08:30:30.946 DEBUG:teuthology.orchestra.run.smithi145:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-10T08:30:30.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph 2024-02-10T08:30:31.014 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph 2024-02-10T08:30:31.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /etc/ceph 2024-02-10T08:30:31.081 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /etc/ceph 2024-02-10T08:30:31.115 INFO:tasks.cephadm:Writing seed config... 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-10T08:30:31.116 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-10T08:30:31.117 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:30:31.117 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-10T08:30:31.139 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a67cbc88-c7ee-11ee-95b8-87774f69a715 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-02-10T08:30:31.140 DEBUG:teuthology.orchestra.run.smithi040:mon.a> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service 2024-02-10T08:30:31.182 DEBUG:teuthology.orchestra.run.smithi040:mgr.y> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service 2024-02-10T08:30:31.209 INFO:journalctl@ceph.mon.a.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:30:31.209 INFO:tasks.cephadm:Bootstrapping... 2024-02-10T08:30:31.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.40 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:30:31.236 INFO:journalctl@ceph.mgr.y.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:30:31.357 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Verifying podman|docker is present... 2024-02-10T08:30:31.357 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Verifying lvm2 is present... 2024-02-10T08:30:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Verifying time synchronization is in place... 2024-02-10T08:30:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-02-10T08:30:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-10T08:30:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-02-10T08:30:31.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-10T08:30:31.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-02-10T08:30:31.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-02-10T08:30:31.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout active 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Repeating the final host check... 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:podman|docker (/bin/podman) is present 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:systemctl is present 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:lvcreate is present 2024-02-10T08:30:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-02-10T08:30:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-10T08:30:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-02-10T08:30:31.389 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-10T08:30:31.389 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-02-10T08:30:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-02-10T08:30:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout active 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Host looks OK 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:root:Cluster fsid: a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Acquiring lock 140249587715320 on /run/cephadm/a67cbc88-c7ee-11ee-95b8-87774f69a715.lock 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Lock 140249587715320 acquired on /run/cephadm/a67cbc88-c7ee-11ee-95b8-87774f69a715.lock 2024-02-10T08:30:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Verifying IP 172.21.15.40 port 3300 ... 2024-02-10T08:30:31.401 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Verifying IP 172.21.15.40 port 6789 ... 2024-02-10T08:30:31.401 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.40, final addrv is [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-02-10T08:30:31.401 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /sbin/ip route ls 2024-02-10T08:30:31.402 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/sbin/ip:stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.40 metric 100 2024-02-10T08:30:31.402 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/sbin/ip:stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.40 metric 100 2024-02-10T08:30:31.402 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Mon IP 172.21.15.40 is in CIDR network 172.21.0.0/20 2024-02-10T08:30:31.404 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2024-02-10T08:30:31.404 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman pull docker.io/ceph/ceph:v15.2.0 2024-02-10T08:30:33.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull docker.io/ceph/ceph:v15.2.0... 2024-02-10T08:30:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures 2024-02-10T08:30:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:120f0bd0d532e2094e4c344cda2d32931787ee8c2e5d6b9ddd4698dfe3ef6110 2024-02-10T08:30:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07 2024-02-10T08:30:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stderr Copying config sha256:204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2024-02-10T08:30:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stderr Writing manifest to image destination 2024-02-10T08:30:51.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/bin/podman:stdout 204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2024-02-10T08:30:51.201 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2024-02-10T08:30:51.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2024-02-10T08:30:51.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2024-02-10T08:30:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:stat:stdout 167 167 2024-02-10T08:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Creating initial keys... 2024-02-10T08:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-10T08:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-10T08:30:53.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQA8NMdlfzUjOBAAHDSeTjYLUQscV0M3kUPnzw== 2024-02-10T08:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-10T08:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-10T08:30:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQA+NMdlDFM2BRAATYWmTS8AiAdVdVTFwtcBKA== 2024-02-10T08:30:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-10T08:30:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-10T08:30:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQA/NMdlvSGBERAAqhj8XI65YOOiPpkviOnQWw== 2024-02-10T08:30:56.208 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Creating initial monmap... 2024-02-10T08:30:56.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/tmp/ceph-tmpd9ys73cj:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', 'a67cbc88-c7ee-11ee-95b8-87774f69a715', '--addv', 'a', '[v2:172.21.15.40:3300,v1:172.21.15.40:6789]', '/tmp/monmap'] 2024-02-10T08:30:56.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /tmp/ceph-tmpd9ys73cj:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 --addv a [v2:172.21.15.40:3300,v1:172.21.15.40:6789] /tmp/monmap 2024-02-10T08:30:56.765 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-10T08:30:56.765 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:30:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-10T08:30:57.373 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Creating mon... 2024-02-10T08:30:57.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpk6bmkkh1:/tmp/keyring:z', '-v', '/tmp/ceph-tmpd9ys73cj:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', 'a67cbc88-c7ee-11ee-95b8-87774f69a715', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2024-02-10T08:30:57.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpk6bmkkh1:/tmp/keyring:z -v /tmp/ceph-tmpd9ys73cj:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-02-10T08:30:57.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.835+0000 7f5b6db936c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T08:30:57.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.835+0000 7f5b6db936c0 1 imported monmap: 2024-02-10T08:30:57.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2024-02-10T08:30:57.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2024-02-10T08:30:56.662646+0000 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2024-02-10T08:30:56.662646+0000 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.835+0000 7f5b6db936c0 0 /usr/bin/ceph-mon: set fsid to a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 0 set rocksdb option compression = kNoCompression 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 0 set rocksdb option compression = kNoCompression 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-10T08:30:57.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Compile date Mar 23 2020 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: DB SUMMARY 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.error_if_exists: 0 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.create_if_missing: 1 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.env: 0x563edbe9a1a0 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.info_log: 0x563ede3f7aa0 2024-02-10T08:30:57.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.statistics: (nil) 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.use_fsync: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.db_log_dir: 2024-02-10T08:30:57.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.write_buffer_manager: 0x563edef96120 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T08:30:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.row_cache: None 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.wal_filter: None 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.two_write_queues: 0 2024-02-10T08:30:57.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.atomic_flush: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.max_open_files: -1 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T08:30:57.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Compression algorithms supported: 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kZSTD supported: 0 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kXpressCompression supported: 0 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kZlibCompression supported: 1 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.836+0000 7f5b6db936c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.merge_operator: 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_filter: None 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563ede31c118) 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2024-02-10T08:30:57.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x563ede356510 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2024-02-10T08:30:57.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T08:30:57.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression: NoCompression 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.num_levels: 7 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T08:30:57.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T08:30:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T08:30:57.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.table_properties_collectors: 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.bloom_locality: 0 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T08:30:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.837+0000 7f5b6db936c0 4 rocksdb: Options.ttl: 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.838+0000 7f5b6db936c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.838+0000 7f5b6db936c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.840+0000 7f5b6db936c0 4 rocksdb: DB pointer 0x563ede3f2400 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.840+0000 7f5b56d54700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.840+0000 7f5b56d54700 4 rocksdb: [db/db_impl.cc:778] 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T08:30:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:30:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:30:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:30:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:30:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-10T08:30:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.842+0000 7f5b6db936c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2024-02-10T08:30:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.842+0000 7f5b6db936c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2024-02-10T08:30:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-10T08:30:57.842+0000 7f5b6db936c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-10T08:30:58.473 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:30:58.477 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2024-02-10T08:30:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2024-02-10T08:30:58.583 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-10T08:30:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2024-02-10T08:30:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target 2024-02-10T08:30:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target → /etc/systemd/system/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target. 2024-02-10T08:30:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target → /etc/systemd/system/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target. 2024-02-10T08:30:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl start ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target 2024-02-10T08:30:58.776 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-02-10T08:30:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a 2024-02-10T08:30:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a 2024-02-10T08:30:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Unit ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service not loaded. 2024-02-10T08:30:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a 2024-02-10T08:30:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target.wants/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service → /etc/systemd/system/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@.service. 2024-02-10T08:30:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl start ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a 2024-02-10T08:30:59.029 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:30:59 smithi040 systemd[1]: Starting Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:30:59.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2024-02-10T08:30:59.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout disabled 2024-02-10T08:30:59.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2024-02-10T08:30:59.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-10T08:30:59.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:firewalld.service is not enabled 2024-02-10T08:30:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for mon to start... 2024-02-10T08:30:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for mon... 2024-02-10T08:30:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2024-02-10T08:30:59.314 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:30:59 smithi040 podman[35386]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.a" found: no such container 2024-02-10T08:30:59.315 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:30:59 smithi040 systemd[1]: Started Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:31:00.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.350021s) 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2024-02-10T08:31:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:00.064 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:30:59 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.682712+0000 mon.a (mon.0) 0 : [INF] mkfs a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:00.064 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:30:59 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.662656+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-10T08:31:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2024-02-10T08:31:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2024-02-10T08:31:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z -v /var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2024-02-10T08:31:00.938 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:00 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.681530+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-10T08:31:00.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:00 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.681707+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0]} 2024-02-10T08:31:00.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:00 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.683858+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-10T08:31:00.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:00 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.687034+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-10T08:31:00.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:00 smithi040 bash[35403]: cluster 2024-02-10T08:30:59.687420+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-10T08:31:00.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:00 smithi040 bash[35403]: audit 2024-02-10T08:31:00.031524+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.40:0/1188091242' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout log_to_journald = false 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 3 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2024-02-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mon] 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim = false 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_memory_target_autotune = true 2024-02-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2024-02-10T08:31:01.868 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2024-02-10T08:31:01.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2024-02-10T08:31:01.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z -v /var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2024-02-10T08:31:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:01 smithi040 bash[35403]: audit 2024-02-10T08:31:01.343259+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.40:0/559650974' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-10T08:31:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:01 smithi040 bash[35403]: audit 2024-02-10T08:31:01.345938+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.40:0/559650974' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-10T08:31:02.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:02 smithi040 bash[35403]: audit 2024-02-10T08:31:02.500661+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.40:0/856377159' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:31:03.125 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Restarting the monitor... 2024-02-10T08:31:03.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a 2024-02-10T08:31:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:03 smithi040 systemd[1]: Stopping Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:31:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:03 smithi040 bash[35403]: debug 2024-02-10T08:31:03.277+0000 7ff3c0cee700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T08:31:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:03 smithi040 bash[35403]: debug 2024-02-10T08:31:03.277+0000 7ff3c0cee700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-10T08:31:04.127 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:03 smithi040 podman[35738]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.a 2024-02-10T08:31:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Setting mon public_network... 2024-02-10T08:31:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2024-02-10T08:31:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Succeeded. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: Stopped Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Found left-over process 35430 (conmon) in control group while starting unit. Ignoring. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Found left-over process 35760 (podman) in control group while starting unit. Ignoring. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: Starting Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 podman[35780]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.a" found: no such container 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Found left-over process 35430 (conmon) in control group while starting unit. Ignoring. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Found left-over process 35760 (podman) in control group while starting unit. Ignoring. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:31:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:04 smithi040 systemd[1]: Started Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.157+0000 7ff7946b06c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.157+0000 7ff7946b06c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.158+0000 7ff7946b06c0 0 pidfile_write: ignore empty --pid-file 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 load: jerasure load: lrc load: isa 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 set rocksdb option compression = kNoCompression 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 set rocksdb option compression = kNoCompression 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-10T08:31:05.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.162+0000 7ff7946b06c0 1 rocksdb: do_open column families: [default] 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Compile date Mar 23 2020 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: DB SUMMARY 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: CURRENT file: CURRENT 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69403 ; 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.error_if_exists: 0 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.create_if_missing: 0 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.env: 0x558992c1d1a0 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.info_log: 0x558994f169c0 2024-02-10T08:31:05.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.statistics: (nil) 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.use_fsync: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.db_log_dir: 2024-02-10T08:31:05.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.write_buffer_manager: 0x558995aaeae0 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T08:31:05.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.row_cache: None 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.wal_filter: None 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T08:31:05.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.two_write_queues: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.atomic_flush: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T08:31:05.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_open_files: -1 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Compression algorithms supported: 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kZSTD supported: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kXpressCompression supported: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kZlibCompression supported: 1 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-10T08:31:05.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.merge_operator: 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_filter: None 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558994e32130) 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cache_index_and_filter_blocks: 1 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: pin_top_level_index_and_filter: 1 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: index_type: 0 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: data_block_index_type: 0 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T08:31:05.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: hash_index_allow_collision: 1 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: checksum: 1 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: no_block_cache: 0 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_cache: 0x558994e6c610 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_cache_name: BinnedLRUCache 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_cache_options: 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: capacity : 536870912 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: num_shard_bits : 4 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: strict_capacity_limit : 0 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: high_pri_pool_ratio: 0.000 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_cache_compressed: (nil) 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: persistent_cache: (nil) 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_size: 4096 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_size_deviation: 10 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_restart_interval: 16 2024-02-10T08:31:05.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: index_block_restart_interval: 1 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: metadata_block_size: 4096 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: partition_filters: 0 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: use_delta_encoding: 1 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: whole_key_filtering: 1 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: verify_compression: 0 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: read_amp_bytes_per_bit: 0 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: format_version: 2 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: enable_index_compression: 1 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: block_align: 0 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression: NoCompression 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T08:31:05.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.num_levels: 7 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T08:31:05.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T08:31:05.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T08:31:05.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.table_properties_collectors: 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.bloom_locality: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T08:31:05.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: Options.ttl: 0 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.163+0000 7ff7946b06c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.164+0000 7ff7946b06c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707553865165082, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.164+0000 7ff7946b06c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.164+0000 7ff7946b06c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707553865165889, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66444, "table_properties": {"data_size": 64739, "index_size": 310, "filter_size": 581, "raw_key_size": 8761, "raw_average_key_size": 46, "raw_value_size": 59698, "raw_average_value_size": 319, "num_data_blocks": 10, "num_entries": 187, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.164+0000 7ff7946b06c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.165+0000 7ff7946b06c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707553865166253, "job": 1, "event": "recovery_finished"} 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.166+0000 7ff7946b06c0 4 rocksdb: DB pointer 0x558994f07200 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.166+0000 7ff77b7fd700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.166+0000 7ff77b7fd700 4 rocksdb: [db/db_impl.cc:778] 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** DB Stats ** 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T08:31:05.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** Compaction Stats [default] ** 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: L0 2/0 66.51 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Sum 2/0 66.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** Compaction Stats [default] ** 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:31:05.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Cumulative compaction: 0.00 GB write, 22.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Interval compaction: 0.00 GB write, 22.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** Compaction Stats [default] ** 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: L0 2/0 66.51 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Sum 2/0 66.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** Compaction Stats [default] ** 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.0 0.00 0.00 1 0.001 0 0 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Cumulative compaction: 0.00 GB write, 22.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:31:05.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.166+0000 7ff7946b06c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] at bind addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 1 mon.a@-1(???) e1 preinit fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 0 mon.a@-1(???).mds e1 new map 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 0 mon.a@-1(???).mds e1 print_map 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: e1 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: legacy client fscid: -1 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: 2024-02-10T08:31:05.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: No filesystems configured 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: audit 2024-02-10T08:31:02.500661+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.40:0/856377159' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.167+0000 7ff7946b06c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expand map: {default=false} 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta from 'false' to 'false' 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expanded map: {default=false} 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expand map: {default=info} 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta from 'info' to 'info' 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expanded map: {default=info} 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expand map: {default=daemon} 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-10T08:31:05.696 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expanded map: {default=daemon} 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expand map: {default=debug} 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta from 'debug' to 'debug' 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: debug 2024-02-10T08:31:05.168+0000 7ff7946b06c0 20 expand_channel_meta expanded map: {default=debug} 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cluster 2024-02-10T08:31:05.184775+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cluster 2024-02-10T08:31:05.184815+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0]} 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cluster 2024-02-10T08:31:05.184848+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cluster 2024-02-10T08:31:05.184872+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-10T08:31:05.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:05 smithi040 bash[35794]: cluster 2024-02-10T08:31:05.185183+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-10T08:31:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Creating mgr... 2024-02-10T08:31:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-02-10T08:31:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y 2024-02-10T08:31:06.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y 2024-02-10T08:31:06.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service: Unit ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service not loaded. 2024-02-10T08:31:06.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y 2024-02-10T08:31:06.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715.target.wants/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@.service. 2024-02-10T08:31:06.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl start ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y 2024-02-10T08:31:06.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:06 smithi040 bash[35794]: audit 2024-02-10T08:31:05.436008+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.40:0/3082867934' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2024-02-10T08:31:06.336 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:06 smithi040 bash[35794]: audit 2024-02-10T08:31:05.438800+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.40:0/3082867934' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2024-02-10T08:31:06.336 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:06 smithi040 systemd[1]: Starting Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:31:06.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2024-02-10T08:31:06.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout disabled 2024-02-10T08:31:06.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2024-02-10T08:31:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-10T08:31:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:firewalld.service is not enabled 2024-02-10T08:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2024-02-10T08:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for mgr to start... 2024-02-10T08:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for mgr... 2024-02-10T08:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-10T08:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-10T08:31:06.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:06 smithi040 podman[36010]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.y" found: no such container 2024-02-10T08:31:06.676 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:06 smithi040 systemd[1]: Started Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "a67cbc88-c7ee-11ee-95b8-87774f69a715", 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-10T08:31:07.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 1, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-10T08:31:07.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-10T08:31:07.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-10T08:30:59.683044+0000", 2024-02-10T08:31:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-10T08:31:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-10T08:31:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:07 smithi040 bash[35794]: audit 2024-02-10T08:31:07.119860+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.40:0/3861201991' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-10T08:31:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2024-02-10T08:31:08.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-10T08:31:08.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-10T08:31:09.463 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:09.463 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:09.463 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "a67cbc88-c7ee-11ee-95b8-87774f69a715", 2024-02-10T08:31:09.463 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-10T08:31:09.464 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-10T08:31:09.465 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-10T08:31:09.470 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-10T08:31:09.471 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-10T08:30:59.683044+0000", 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-10T08:31:09.472 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:09.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:09 smithi040 bash[35794]: audit 2024-02-10T08:31:09.460707+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.40:0/3267852186' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-10T08:31:10.208 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2024-02-10T08:31:11.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-10T08:31:11.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: cluster 2024-02-10T08:31:10.738206+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: cluster 2024-02-10T08:31:10.740878+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00277418s) 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: audit 2024-02-10T08:31:10.741428+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: audit 2024-02-10T08:31:10.741586+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: audit 2024-02-10T08:31:10.741747+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: audit 2024-02-10T08:31:10.742117+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: audit 2024-02-10T08:31:10.742351+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: cluster 2024-02-10T08:31:10.756235+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2024-02-10T08:31:11.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:11 smithi040 bash[35794]: audit 2024-02-10T08:31:10.766869+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-10T08:31:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "a67cbc88-c7ee-11ee-95b8-87774f69a715", 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-10T08:31:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 6, 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-10T08:31:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 2, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-10T08:31:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-10T08:31:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-10T08:30:59.683044+0000", 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-10T08:31:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Enabling cephadm module... 2024-02-10T08:31:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2024-02-10T08:31:12.397 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.196986+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: cluster 2024-02-10T08:31:11.197023+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.199163+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.199359+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"7a21adc8-59eb-46e3-89b2-bbb65f557d4a"}]: dispatch 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.204614+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"7a21adc8-59eb-46e3-89b2-bbb65f557d4a"}]': finished 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.205317+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"31f53ea9-5be3-49fb-8f98-d799dd73f94b"}]: dispatch 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.210298+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"31f53ea9-5be3-49fb-8f98-d799dd73f94b"}]': finished 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: cluster 2024-02-10T08:31:11.744326+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.00622s) 2024-02-10T08:31:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:13 smithi040 bash[35794]: audit 2024-02-10T08:31:11.785172+0000 mon.a (mon.0) 27 : audit [DBG] from='client.? 172.21.15.40:0/600802702' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-10T08:31:14.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[36026]: ignoring --setuser ceph since I am not root 2024-02-10T08:31:14.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[36026]: ignoring --setgroup ceph since I am not root 2024-02-10T08:31:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[35794]: audit 2024-02-10T08:31:12.202500+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 172.21.15.40:0/2208184993' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:31:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[35794]: cluster 2024-02-10T08:31:12.202538+0000 mon.a (mon.0) 29 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-10T08:31:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[35794]: audit 2024-02-10T08:31:12.204477+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-10T08:31:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[35794]: audit 2024-02-10T08:31:13.088902+0000 mon.a (mon.0) 31 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-10T08:31:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:14 smithi040 bash[35794]: audit 2024-02-10T08:31:13.286330+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.40:0/3127403683' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-10T08:31:14.745 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-02-10T08:31:14.746 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-02-10T08:31:15.098 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:15 smithi040 bash[35794]: audit 2024-02-10T08:31:14.092996+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.40:0/3127403683' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-10T08:31:15.098 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:15 smithi040 bash[35794]: cluster 2024-02-10T08:31:14.093044+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e4: y(active, since 3s) 2024-02-10T08:31:17.803 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.803 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 4, 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:6800", 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 719461906 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:6801", 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 719461906 2024-02-10T08:31:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.40:6801/719461906", 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-02-10T08:31:10.738095+0000", 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.809 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.810 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-02-10T08:31:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-02-10T08:31:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-02-10T08:31:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-02-10T08:31:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-02-10T08:31:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-02-10T08:31:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-10T08:31:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.829 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.830 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-10T08:31:17.831 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.832 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.833 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-02-10T08:31:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-02-10T08:31:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-02-10T08:31:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.846 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.847 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.848 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-02-10T08:31:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.851 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.852 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.855 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.856 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.857 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-02-10T08:31:17.858 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.859 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.860 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.861 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.862 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.863 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-10T08:31:17.866 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.869 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.870 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.871 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.872 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.873 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.875 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-10T08:31:17.876 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-10T08:31:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-10T08:31:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.879 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.880 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.881 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.882 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-02-10T08:31:17.883 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-02-10T08:31:17.884 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.885 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.886 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.887 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.888 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.889 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-02-10T08:31:17.890 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-02-10T08:31:17.891 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.892 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.893 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.894 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.895 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.897 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.898 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.899 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.900 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.901 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.902 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.903 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.904 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.905 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.906 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.907 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-02-10T08:31:17.908 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.909 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.910 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.912 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.913 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.914 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.915 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-10T08:31:17.922 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.923 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.924 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.925 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.926 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.927 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.928 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-02-10T08:31:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.943 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.944 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.945 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.946 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.947 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.948 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.949 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-10T08:31:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-02-10T08:31:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-02-10T08:31:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.969 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-02-10T08:31:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.983 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.984 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.985 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.986 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.987 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.988 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:17.995 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:17.999 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.000 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.001 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.003 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.005 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.008 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.012 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.013 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-02-10T08:31:18.014 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.015 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.016 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.017 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.039 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.041 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-02-10T08:31:18.042 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-02-10T08:31:18.043 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.045 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.046 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.047 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.049 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.050 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.054 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.057 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.058 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.059 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.060 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.061 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.062 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:18.063 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.064 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.065 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.066 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.067 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.068 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.069 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-02-10T08:31:18.070 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.073 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.074 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.076 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.080 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-02-10T08:31:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-02-10T08:31:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-02-10T08:31:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-10T08:31:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:0", 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 459015756 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:0", 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2925255174 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:0", 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4289777270 2024-02-10T08:31:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:18.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:18.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:18.098 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:17 smithi040 bash[35794]: audit 2024-02-10T08:31:17.181856+0000 mon.a (mon.0) 35 : audit [DBG] from='client.? 172.21.15.40:0/2231907888' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-10T08:31:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:18 smithi040 bash[35794]: cluster 2024-02-10T08:31:17.976904+0000 mon.a (mon.0) 36 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:31:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:18 smithi040 bash[35794]: cluster 2024-02-10T08:31:17.977300+0000 mon.a (mon.0) 37 : cluster [INF] Activating manager daemon y 2024-02-10T08:31:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:18 smithi040 bash[35794]: cluster 2024-02-10T08:31:17.979067+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-10T08:31:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: cluster 2024-02-10T08:31:18.238450+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e5: y(active, starting, since 0.261218s) 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.239905+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.240672+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.240862+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.241042+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.241363+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.241954+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.242218+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: cluster 2024-02-10T08:31:18.255300+0000 mon.a (mon.0) 47 : cluster [INF] Manager daemon y is now available 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:18.276024+0000 mon.a (mon.0) 48 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-10T08:31:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:19 smithi040 bash[35794]: audit 2024-02-10T08:31:19.157508+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-10T08:31:20.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:20 smithi040 bash[35794]: cluster 2024-02-10T08:31:19.242780+0000 mon.a (mon.0) 50 : cluster [DBG] mgrmap e6: y(active, since 1.26555s) 2024-02-10T08:31:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:21 smithi040 bash[35794]: cluster 2024-02-10T08:31:20.245219+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 2s) 2024-02-10T08:31:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-02-10T08:31:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for Mgr epoch 4... 2024-02-10T08:31:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-02-10T08:31:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-02-10T08:31:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2024-02-10T08:31:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-02-10T08:31:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:28.163 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2024-02-10T08:31:28.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2024-02-10T08:31:28.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2024-02-10T08:31:29.423 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:28 smithi040 bash[35794]: audit 2024-02-10T08:31:28.929111+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2024-02-10T08:31:29.423 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:28 smithi040 bash[35794]: audit 2024-02-10T08:31:28.931593+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2024-02-10T08:31:29.761 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Generating ssh key... 2024-02-10T08:31:29.762 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2024-02-10T08:31:29.762 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2024-02-10T08:31:30.043 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:29 smithi040 bash[35794]: audit 2024-02-10T08:31:28.927942+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: Generating public/private rsa key pair. 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: Your identification has been saved in /tmp/tmp754_0mhd/key. 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: Your public key has been saved in /tmp/tmp754_0mhd/key.pub. 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: The key fingerprint is: 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: SHA256:ITiT5Wpsa403h1xIiiUKKIEMxw9UFhLo/1awDiK2I5Q ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: The key's randomart image is: 2024-02-10T08:31:30.838 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: +---[RSA 3072]----+ 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |*+=o+.. | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |++oo = | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |= .o* + . | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |oo =.B o . | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |. + * + S | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |.E = * + | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |+ o B B . | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |.o . = o | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: |. . . | 2024-02-10T08:31:30.839 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:30 smithi040 bash[36026]: +----[SHA256]-----+ 2024-02-10T08:31:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2024-02-10T08:31:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2024-02-10T08:31:31.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:31 smithi040 bash[35794]: audit 2024-02-10T08:31:30.441806+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:31:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:31 smithi040 bash[35794]: cephadm 2024-02-10T08:31:30.442006+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2024-02-10T08:31:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:31 smithi040 bash[35794]: audit 2024-02-10T08:31:30.514351+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAvHsPgvmCv7HqUY0toDYdU0+g26SN+Tw4vYigziSxc2TasrpbYHxQ\n3rwUG2dXmW5zSS0qJ7U527Zk4iPLDTK0Jon2x2h+DEzCTDZPtGISgRDjRdYlDmwGljSprJ\nGDl8S3UBVKfeq3vkgiDYslpc/LCivDxlvyh7wXCHo5ETjiv+1TmR8dP7wcjhYQ+4x2Igb9\nsOuRcsHr36ekRtoIKVm5YWKp9WjhAhkBMn3pj7RHd2bu9RGQyzjmmAq8jr684QrqUfw5Ce\n5oxK9gAezDOt9qgWNj0mgG2PwqPTkNetkL0+t9RaDLnN86OujIZg81NeBNYt2Lxs97Wjhm\nMYgWAr/i5NscjEiSMg46YcSzjpR+gbvmhwPyDDKjjtlMmzMqR71CX4dYbjPjpUUEAC1oBt\nP76utPIhdb/xSRNiq98EmrYlq5PdYoMPAcuvTANxsz9B3lk9mV4+legvzzv8SqvmvS0gP2\nAgTZZAnTIBwvPkdY7aVOcUGZxdEtu5MNrg2l0mSHAAAFoNL27Z7S9u2eAAAAB3NzaC1yc2\nEAAAGBALx7D4L5gr+x6lGNLaA2HVNPoNukjfk8OL2IoM4ksXNk2rK6W2B8UN68FBtnV5lu\nc0ktKie1Odu2ZOIjyw0ytCaJ9sdofgxMwkw2T7RiEoEQ40XWJQ5sBpY0qayRg5fEt1AVSn\n3qt75IIg2LJaXPyworw8Zb8oe8Fwh6ORE44r/tU5kfHT+8HI4WEPuMdiIG/bDrkXLB69+n\npEbaCClZuWFiqfVo4QIZATJ96Y+0R3dm7vURkMs45pgKvI6+vOEK6lH8OQnuaMSvYAHswz\nrfaoFjY9JoBtj8Kj05DXrZC9PrfUWgy5zfOjroyGYPNTXgTWLdi8bPe1o4ZjGIFgK/4uTb\nHIxIkjIOOmHEs46UfoG75ocD8gwyo47ZTJszKke9Ql+HWG4z46VFBAAtaAbT++rrTyIXW/\n8UkTYqvfBJq2JauT3WKDDwHLr0wDcbM/Qd5ZPZlePpXoL887/Eqr5r0tID9gIE2WQJ0yAc\nLz5HWO2lTnFBmcXRLbuTDa4NpdJkhwAAAAMBAAEAAAGBALUOFcGAQ6w3kVqTnq+XLCZ6iJ\nBVi5hO1Eald6turhOmXztvLxYJdXnw+/OzGwAljJNP0n3gZdr8Y/6j2YstGMcooqm9Y9AW\n8FJbnccuqo3XFitg4anv9YfWwOMnyVxCOMGyIiPBFI6yJhwSfbDBYk676c2jR+BBu3KGTk\nmP9qndpf+iVuuBnYCUC+5IaLaZNpv8PnUZeacYGAODsHFgYmb9azx2aicks/S35WQJDtnR\nRFygahH97+0/6w/IhBI982F4xc0p0Dh4KzWHJb5evuLlUNmF8kMUESUOXAz+6v2T+Pc6h0\nfVWlgtSge8BzgAoUzPJQAeP7xYXzC+Dg39xJvLgbBzTXkxpH6ENy68FnRknQXUnRt4Z2oZ\nEdX5GEnASXURjdSvyJ+/2QsRTc+nl0POi4CBLy2T76ugNsD+IPvzthw9hwIFAOmBuyf2hj\n04f52f+njVWTlEeTRoDlnmasokUjYRL2CKLH0YYGfdjAAvhaGrdvIu+B/AS0grJI1DYQAA\nAMEAz3vXspm71McUXMcUZIntL4iy7farXz/2vUn8OFmH11XADsHyVgzmMdPtLmKQ2WR9Bp\n+DBk6A0esiJPg3wcVvSLME/ngtzx+VDbV3mcEwZ73xaU4vPzjCeOkfS4oh95YFEy58kieM\noo4d2P+UR/mkib5wSm2w6Ckltf3k9cssA3GEEyb2IxP1ufOv3dVdXkHGnQrCS2tSuRrF/w\n8iVUrfOU4XEIppWuiVU1b6IfOn6pIjmcjezG56bLOhICD1L6LrAAAAwQDg6rBVyjsv2E2t\nK90Ju6Dk+gKv12NnjKUNcDpZ3I3z0N8Njr3G93G1CnlASzARz2kUs32MEAlKnmLCGCBKQI\nat9KvXTII54SZTH6zmvDDGwBM1fepKb69wK7e1U4tVH/wbRuJir6+rPqVjmUjkVkBcgxrj\nUCBdqp7y67MWRQ+7ddnIXze21xgbbTjxMrS3MOGupHMJH4BqPolHjl5d8OQfPq+XznsMiH\nx2dYufxxApWHobcMXr0m1SrKSGrEeMtjcAAADBANaHTco8UZWJt8UDWNmbzmLqgTxd+utZ\nUzCXdU64n6QH//dcJVJUm4OOXOuZh85ob6BdW6cRRz9cauNWN2BlSsu4v434vY3DF9JxXA\n3i0IMLyuIIVpZzzC6Ezdf1ZkI6Xd3U2CZfWiIw2iD3hF0gf6YEbwyXkWNCLhbbojsEr3R3\nx4MUk4dymd67FWQMtBHUy+JhBj18GwqS2s/54HJehZJR/9lgvyfccBnZ+8YI6WHmOhNf3m\nGBCrEX2IbHxPacMQAAACljZXBoLWE2N2NiYzg4LWM3ZWUtMTFlZS05NWI4LTg3Nzc0ZjY5\nYTcxNQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:31:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:31 smithi040 bash[35794]: audit 2024-02-10T08:31:30.516119+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAvHsPgvmCv7HqUY0toDYdU0+g26SN+Tw4vYigziSxc2TasrpbYHxQ\n3rwUG2dXmW5zSS0qJ7U527Zk4iPLDTK0Jon2x2h+DEzCTDZPtGISgRDjRdYlDmwGljSprJ\nGDl8S3UBVKfeq3vkgiDYslpc/LCivDxlvyh7wXCHo5ETjiv+1TmR8dP7wcjhYQ+4x2Igb9\nsOuRcsHr36ekRtoIKVm5YWKp9WjhAhkBMn3pj7RHd2bu9RGQyzjmmAq8jr684QrqUfw5Ce\n5oxK9gAezDOt9qgWNj0mgG2PwqPTkNetkL0+t9RaDLnN86OujIZg81NeBNYt2Lxs97Wjhm\nMYgWAr/i5NscjEiSMg46YcSzjpR+gbvmhwPyDDKjjtlMmzMqR71CX4dYbjPjpUUEAC1oBt\nP76utPIhdb/xSRNiq98EmrYlq5PdYoMPAcuvTANxsz9B3lk9mV4+legvzzv8SqvmvS0gP2\nAgTZZAnTIBwvPkdY7aVOcUGZxdEtu5MNrg2l0mSHAAAFoNL27Z7S9u2eAAAAB3NzaC1yc2\nEAAAGBALx7D4L5gr+x6lGNLaA2HVNPoNukjfk8OL2IoM4ksXNk2rK6W2B8UN68FBtnV5lu\nc0ktKie1Odu2ZOIjyw0ytCaJ9sdofgxMwkw2T7RiEoEQ40XWJQ5sBpY0qayRg5fEt1AVSn\n3qt75IIg2LJaXPyworw8Zb8oe8Fwh6ORE44r/tU5kfHT+8HI4WEPuMdiIG/bDrkXLB69+n\npEbaCClZuWFiqfVo4QIZATJ96Y+0R3dm7vURkMs45pgKvI6+vOEK6lH8OQnuaMSvYAHswz\nrfaoFjY9JoBtj8Kj05DXrZC9PrfUWgy5zfOjroyGYPNTXgTWLdi8bPe1o4ZjGIFgK/4uTb\nHIxIkjIOOmHEs46UfoG75ocD8gwyo47ZTJszKke9Ql+HWG4z46VFBAAtaAbT++rrTyIXW/\n8UkTYqvfBJq2JauT3WKDDwHLr0wDcbM/Qd5ZPZlePpXoL887/Eqr5r0tID9gIE2WQJ0yAc\nLz5HWO2lTnFBmcXRLbuTDa4NpdJkhwAAAAMBAAEAAAGBALUOFcGAQ6w3kVqTnq+XLCZ6iJ\nBVi5hO1Eald6turhOmXztvLxYJdXnw+/OzGwAljJNP0n3gZdr8Y/6j2YstGMcooqm9Y9AW\n8FJbnccuqo3XFitg4anv9YfWwOMnyVxCOMGyIiPBFI6yJhwSfbDBYk676c2jR+BBu3KGTk\nmP9qndpf+iVuuBnYCUC+5IaLaZNpv8PnUZeacYGAODsHFgYmb9azx2aicks/S35WQJDtnR\nRFygahH97+0/6w/IhBI982F4xc0p0Dh4KzWHJb5evuLlUNmF8kMUESUOXAz+6v2T+Pc6h0\nfVWlgtSge8BzgAoUzPJQAeP7xYXzC+Dg39xJvLgbBzTXkxpH6ENy68FnRknQXUnRt4Z2oZ\nEdX5GEnASXURjdSvyJ+/2QsRTc+nl0POi4CBLy2T76ugNsD+IPvzthw9hwIFAOmBuyf2hj\n04f52f+njVWTlEeTRoDlnmasokUjYRL2CKLH0YYGfdjAAvhaGrdvIu+B/AS0grJI1DYQAA\nAMEAz3vXspm71McUXMcUZIntL4iy7farXz/2vUn8OFmH11XADsHyVgzmMdPtLmKQ2WR9Bp\n+DBk6A0esiJPg3wcVvSLME/ngtzx+VDbV3mcEwZ73xaU4vPzjCeOkfS4oh95YFEy58kieM\noo4d2P+UR/mkib5wSm2w6Ckltf3k9cssA3GEEyb2IxP1ufOv3dVdXkHGnQrCS2tSuRrF/w\n8iVUrfOU4XEIppWuiVU1b6IfOn6pIjmcjezG56bLOhICD1L6LrAAAAwQDg6rBVyjsv2E2t\nK90Ju6Dk+gKv12NnjKUNcDpZ3I3z0N8Njr3G93G1CnlASzARz2kUs32MEAlKnmLCGCBKQI\nat9KvXTII54SZTH6zmvDDGwBM1fepKb69wK7e1U4tVH/wbRuJir6+rPqVjmUjkVkBcgxrj\nUCBdqp7y67MWRQ+7ddnIXze21xgbbTjxMrS3MOGupHMJH4BqPolHjl5d8OQfPq+XznsMiH\nx2dYufxxApWHobcMXr0m1SrKSGrEeMtjcAAADBANaHTco8UZWJt8UDWNmbzmLqgTxd+utZ\nUzCXdU64n6QH//dcJVJUm4OOXOuZh85ob6BdW6cRRz9cauNWN2BlSsu4v434vY3DF9JxXA\n3i0IMLyuIIVpZzzC6Ezdf1ZkI6Xd3U2CZfWiIw2iD3hF0gf6YEbwyXkWNCLhbbojsEr3R3\nx4MUk4dymd67FWQMtBHUy+JhBj18GwqS2s/54HJehZJR/9lgvyfccBnZ+8YI6WHmOhNf3m\nGBCrEX2IbHxPacMQAAACljZXBoLWE2N2NiYzg4LWM3ZWUtMTFlZS05NWI4LTg3Nzc0ZjY5\nYTcxNQ==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2024-02-10T08:31:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:31 smithi040 bash[35794]: audit 2024-02-10T08:31:30.516443+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715\n"}]: dispatch 2024-02-10T08:31:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:31 smithi040 bash[35794]: audit 2024-02-10T08:31:30.518365+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715\n"}]': finished 2024-02-10T08:31:31.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:32.549 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2024-02-10T08:31:32.549 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2024-02-10T08:31:32.550 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Adding host smithi040... 2024-02-10T08:31:32.550 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'smithi040'] 2024-02-10T08:31:32.550 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add smithi040 2024-02-10T08:31:32.551 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:32 smithi040 bash[35794]: audit 2024-02-10T08:31:31.823861+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:31:33.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:33 smithi040 bash[36026]: Warning: Permanently added 'smithi040,172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-10T08:31:34.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:33 smithi040 bash[35794]: audit 2024-02-10T08:31:33.810924+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"smithi040\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:31:34.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:33 smithi040 bash[35794]: audit 2024-02-10T08:31:33.812606+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"smithi040\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:31:34.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi040' 2024-02-10T08:31:35.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:34 smithi040 bash[35794]: audit 2024-02-10T08:31:33.290033+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi040", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:31:35.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:34 smithi040 bash[35794]: cephadm 2024-02-10T08:31:33.813093+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host smithi040 2024-02-10T08:31:35.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:34 smithi040 bash[35794]: audit 2024-02-10T08:31:34.041583+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:31:35.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:34 smithi040 bash[35794]: audit 2024-02-10T08:31:34.043311+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:31:35.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:34 smithi040 bash[35794]: audit 2024-02-10T08:31:34.043774+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.14117 172.21.15.40:0/629199041' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:31:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Enabling the dashboard module... 2024-02-10T08:31:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2024-02-10T08:31:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2024-02-10T08:31:36.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:36 smithi040 bash[35794]: audit 2024-02-10T08:31:36.041814+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.40:0/1839932883' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-10T08:31:36.426 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:36 smithi040 bash[36026]: ignoring --setuser ceph since I am not root 2024-02-10T08:31:36.426 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:36 smithi040 bash[36026]: ignoring --setgroup ceph since I am not root 2024-02-10T08:31:36.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-02-10T08:31:36.824 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-02-10T08:31:37.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:37 smithi040 bash[35794]: audit 2024-02-10T08:31:36.182189+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.40:0/1839932883' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-10T08:31:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:37 smithi040 bash[35794]: cluster 2024-02-10T08:31:36.182225+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e8: y(active, since 18s) 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 8, 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:6800", 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4171225302 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:6801", 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4171225302 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.40:6801/4171225302", 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-02-10T08:31:17.977221+0000", 2024-02-10T08:31:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-02-10T08:31:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-10T08:31:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-02-10T08:31:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-10T08:31:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-10T08:31:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2024-02-10T08:31:38.087 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.088 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.092 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.097 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-02-10T08:31:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-02-10T08:31:38.099 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.100 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.101 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.102 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.103 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-10T08:31:38.104 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.105 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-10T08:31:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.109 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.113 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-10T08:31:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-02-10T08:31:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-02-10T08:31:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.119 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.120 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.121 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.122 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-02-10T08:31:38.123 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.124 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.125 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.126 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.127 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-02-10T08:31:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-02-10T08:31:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-10T08:31:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-02-10T08:31:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.162 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.163 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-10T08:31:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-10T08:31:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.167 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.168 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-10T08:31:38.169 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.170 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.171 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.173 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.174 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-10T08:31:38.175 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-10T08:31:38.176 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.177 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.178 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.187 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-02-10T08:31:38.188 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.194 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.200 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.201 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.202 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.203 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.204 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:38.205 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.206 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.207 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.210 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.211 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-10T08:31:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-02-10T08:31:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-02-10T08:31:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-02-10T08:31:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-02-10T08:31:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.226 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.227 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.228 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.229 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.231 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.233 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.234 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.235 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.236 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.237 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.238 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-02-10T08:31:38.239 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-02-10T08:31:38.240 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.242 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-02-10T08:31:38.252 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.253 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.254 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.256 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.257 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.258 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.259 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.260 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-10T08:31:38.261 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.262 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.263 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.264 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.268 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-10T08:31:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-02-10T08:31:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.277 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-02-10T08:31:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.284 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.285 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.287 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.288 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.289 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.290 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.291 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.292 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.293 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.294 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-02-10T08:31:38.295 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.296 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.297 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.298 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.299 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.300 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.301 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.302 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.306 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-02-10T08:31:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-02-10T08:31:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-02-10T08:31:38.323 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.327 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.328 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.333 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-02-10T08:31:38.336 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-02-10T08:31:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.343 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.344 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.345 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.346 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.347 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.348 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.349 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.357 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.362 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-02-10T08:31:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-10T08:31:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-10T08:31:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-02-10T08:31:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-10T08:31:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:0", 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1760596844 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:0", 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1439866558 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-10T08:31:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.40:0", 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1452386819 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:38.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:38 smithi040 bash[35794]: audit 2024-02-10T08:31:37.687376+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.40:0/849648257' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-10T08:31:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-02-10T08:31:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Waiting for Mgr epoch 8... 2024-02-10T08:31:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-02-10T08:31:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-02-10T08:31:40.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:31:40 smithi040 bash[36026]: Warning: Permanently added 'smithi040,172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-10T08:31:40.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:40 smithi040 bash[35794]: cluster 2024-02-10T08:31:40.078941+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2024-02-10T08:31:40.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:40 smithi040 bash[35794]: cluster 2024-02-10T08:31:40.079366+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2024-02-10T08:31:40.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:40 smithi040 bash[35794]: cluster 2024-02-10T08:31:40.081025+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-10T08:31:41.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-10T08:31:41.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 10, 2024-02-10T08:31:41.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-02-10T08:31:41.149 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-10T08:31:41.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: cluster 2024-02-10T08:31:40.131694+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e9: y(active, starting, since 0.0524047s) 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.134870+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.135630+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.135783+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.135890+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.136173+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.136658+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.136844+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.137028+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.137232+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.137429+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.137613+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: cluster 2024-02-10T08:31:40.150417+0000 mon.a (mon.0) 82 : cluster [INF] Manager daemon y is now available 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:40.173726+0000 mon.a (mon.0) 83 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-10T08:31:41.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:41.055336+0000 mon.a (mon.0) 84 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-10T08:31:41.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:41 smithi040 bash[35794]: audit 2024-02-10T08:31:41.058631+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:31:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2024-02-10T08:31:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2024-02-10T08:31:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2024-02-10T08:31:42.314 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:42 smithi040 bash[35794]: cluster 2024-02-10T08:31:41.139800+0000 mon.a (mon.0) 86 : cluster [DBG] mgrmap e10: y(active, since 1.06051s) 2024-02-10T08:31:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2024-02-10T08:31:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:43 smithi040 bash[35794]: cluster 2024-02-10T08:31:42.142765+0000 mon.a (mon.0) 87 : cluster [DBG] mgrmap e11: y(active, since 2s) 2024-02-10T08:31:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:43 smithi040 bash[35794]: audit 2024-02-10T08:31:42.773002+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDohYlQDphEHJ/eyyyhz0M/MA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yNDAyMTAwODMx\nNDJaFw0zNDAyMDcwODMxNDJaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALVBwrjp\nzNrQ6Ruu5srhKv6E4PgOE9BOGWugNvCRUIQX2WiVThPRPbP/xQHqDxFPS5C5yoN/\nLPUdAsoSCwZZ6hv6mTVLQjyjrF+56holdddJBmvmJKDV//f0RKX7Ko3d1NSskxF+\nXTxphwAaOffdIgmi22PoVOe6ZQV+AjyS+9ELSabgi4xBOrD4F8rBONfmq0Dm4vwQ\nW5oRM5cj5OSHkxb6v3DMdOdPOpiQEDvn5WsYAm94k75W/6W6tl87/LpH6ek5g875\nA5ZYVhkg1D0eGgLaK3ac45s71NB+j4pO1CmaJJiE/SoJoDcj2qaordJLFViX9iNu\ntkxwcj1aFNHCzqUCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAef8aDeGU9Fhd1sKY\nbqJtMyrXgkk22itchwmYj+TdU1UIO+WBf2QatUn3D/1+nJrAVA6RNL5DpCIJayhL\nPDTCco2D4PIKhm7pHiPYyHfnsDu7ktKuFLK9e9Hajswynujyi3LrKtA7kP1LNTMG\nZ1Eb2/f38EsWeCthsxUCQ1mIRkfLMpyFn5FJxc/luuMkhjkwXWD0KR+xjFvfkKXs\nPmFvA8By03Led605etgxMJ6Uk6SgjleqA1lpr4XOnAK9ZAbnAzm2IfwMl8UAkFm7\n7nK9wquKDBHO6wxItSuYGZNlPRF1OCMYRgaAwtwqn57ipax3EHqPKMlDF4zn4/3X\nFNPGfA==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:31:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:43 smithi040 bash[35794]: audit 2024-02-10T08:31:42.774707+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDohYlQDphEHJ/eyyyhz0M/MA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yNDAyMTAwODMx\nNDJaFw0zNDAyMDcwODMxNDJaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALVBwrjp\nzNrQ6Ruu5srhKv6E4PgOE9BOGWugNvCRUIQX2WiVThPRPbP/xQHqDxFPS5C5yoN/\nLPUdAsoSCwZZ6hv6mTVLQjyjrF+56holdddJBmvmJKDV//f0RKX7Ko3d1NSskxF+\nXTxphwAaOffdIgmi22PoVOe6ZQV+AjyS+9ELSabgi4xBOrD4F8rBONfmq0Dm4vwQ\nW5oRM5cj5OSHkxb6v3DMdOdPOpiQEDvn5WsYAm94k75W/6W6tl87/LpH6ek5g875\nA5ZYVhkg1D0eGgLaK3ac45s71NB+j4pO1CmaJJiE/SoJoDcj2qaordJLFViX9iNu\ntkxwcj1aFNHCzqUCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAef8aDeGU9Fhd1sKY\nbqJtMyrXgkk22itchwmYj+TdU1UIO+WBf2QatUn3D/1+nJrAVA6RNL5DpCIJayhL\nPDTCco2D4PIKhm7pHiPYyHfnsDu7ktKuFLK9e9Hajswynujyi3LrKtA7kP1LNTMG\nZ1Eb2/f38EsWeCthsxUCQ1mIRkfLMpyFn5FJxc/luuMkhjkwXWD0KR+xjFvfkKXs\nPmFvA8By03Led605etgxMJ6Uk6SgjleqA1lpr4XOnAK9ZAbnAzm2IfwMl8UAkFm7\n7nK9wquKDBHO6wxItSuYGZNlPRF1OCMYRgaAwtwqn57ipax3EHqPKMlDF4zn4/3X\nFNPGfA==\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:31:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:43 smithi040 bash[35794]: audit 2024-02-10T08:31:42.775055+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1QcK46cza0Okb\nrubK4Sr+hOD4DhPQThlroDbwkVCEF9lolU4T0T2z/8UB6g8RT0uQucqDfyz1HQLK\nEgsGWeob+pk1S0I8o6xfueoaJXXXSQZr5iSg1f/39ESl+yqN3dTUrJMRfl08aYcA\nGjn33SIJottj6FTnumUFfgI8kvvRC0mm4IuMQTqw+BfKwTjX5qtA5uL8EFuaETOX\nI+Tkh5MW+r9wzHTnTzqYkBA75+VrGAJveJO+Vv+lurZfO/y6R+npOYPO+QOWWFYZ\nINQ9HhoC2it2nOObO9TQfo+KTtQpmiSYhP0qCaA3I9qmqK3SSxVYl/YjbrZMcHI9\nWhTRws6lAgMBAAECggEBAIpTGyU+16UN1TfZLCwb1lHSWlUzeQ946pFl/UdtvkJw\naOwVNTaOckZRpKknVERjfUl/X/smLMsKTryjNGKub6jWf+FaA7x/M+cB3JQDjoCz\nLAFf6wgLCILTmSgKG5mUdv2ujbXF96VI60u6uA5eZcFw1XjTLyiA6ONeHJrZmO8Y\nIkR3/xH+p+khH4pXpKks4LyROmVypcj4b4/8pazhsowgAM3d62KbhaK/zvtMf+Jz\nu5+eqx4BjZqlBUnxwrC77cTN66ag8Vd0doyKSzGF24Nypu8Eu/1K/5da7uZAznlk\n8aKSv6Kdb9z99+CbjC7/YXXUpncFN9x4UXZlRfaLoQECgYEA6cmAfXyf15ZBVJQN\nF/7vvlZQ6OzVL/IX3VU3xmXRXjuhS+TQ8LeUYRXzv0j9wqmsmvCg+ZQ6iSCx2IRJ\nccNGYm28fRx3bpnUtZjM+6/8xU3QljhB+2A5oldE9zhUUAuB/gMgqbVKvUEinBWQ\nJXT8ub5Qyfik+olEHYfQbNwn50UCgYEAxnqLaVsZl49+bJb88J2+vpieB0rrI/rx\n3xB8dEY5+Lbu4McWhpbnwjrE7aSdCKqc+NsZBiHQ0AL9N5QsOdAFEZZ5nWfSwJrS\ne8vH95IcPNuzxfv4D/3Ls0u6fUxhYAU4mN+Ws62Y4kXa+TpMUXr8WyVhLv6I1fNZ\nI6Dv1MINj+ECgYEAtXhC86UkEd1BEtzlGQY7pFwt68/CX7gkzBpU8/yeuu3Acz/G\n68MkOwQmMwn+Z/b60z4LRg/ILB8jzXRJ6jNw1ABoOhk5n7Fqyhc0rf1aUPDpA2Hh\n3bVAp4HkN54S3BtCqSBWX0UpIaSIr+2Q+XJIpglTfqMxtIOOSvncUFPH6Z0CgYEA\npd+2cUdcfQjEXJZXL/R1fC5qK6gWGgzYZVcO29HxEwY3X42jKrolWHLrL7xaLOsB\nowzgvfo23BETdIaV638JLWi3nLAvNx5s+F8XcLUgelAWz0jESQEPY3nPknXqD2ht\no32BIgrb8Yb1+UIalCIXk0kLDk5VJ5FnltoidYnz8aECgYBXiLqNR0JixU+M37hH\nydDE8jT0bE77QSJIi09WouTLT3eT7QBQh5FOAkCESVt6SAX+23+UscuDA9150BbI\nsLrvAwfzsh0DaqCGFf/z9e11paLiQaThxnydxh6wUy7YsBouTBZvVA4VEhV9uHEh\nCzmtEegAUPWCsJZRBSuh6Mo7cA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:31:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:43 smithi040 bash[35794]: audit 2024-02-10T08:31:42.776975+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1QcK46cza0Okb\nrubK4Sr+hOD4DhPQThlroDbwkVCEF9lolU4T0T2z/8UB6g8RT0uQucqDfyz1HQLK\nEgsGWeob+pk1S0I8o6xfueoaJXXXSQZr5iSg1f/39ESl+yqN3dTUrJMRfl08aYcA\nGjn33SIJottj6FTnumUFfgI8kvvRC0mm4IuMQTqw+BfKwTjX5qtA5uL8EFuaETOX\nI+Tkh5MW+r9wzHTnTzqYkBA75+VrGAJveJO+Vv+lurZfO/y6R+npOYPO+QOWWFYZ\nINQ9HhoC2it2nOObO9TQfo+KTtQpmiSYhP0qCaA3I9qmqK3SSxVYl/YjbrZMcHI9\nWhTRws6lAgMBAAECggEBAIpTGyU+16UN1TfZLCwb1lHSWlUzeQ946pFl/UdtvkJw\naOwVNTaOckZRpKknVERjfUl/X/smLMsKTryjNGKub6jWf+FaA7x/M+cB3JQDjoCz\nLAFf6wgLCILTmSgKG5mUdv2ujbXF96VI60u6uA5eZcFw1XjTLyiA6ONeHJrZmO8Y\nIkR3/xH+p+khH4pXpKks4LyROmVypcj4b4/8pazhsowgAM3d62KbhaK/zvtMf+Jz\nu5+eqx4BjZqlBUnxwrC77cTN66ag8Vd0doyKSzGF24Nypu8Eu/1K/5da7uZAznlk\n8aKSv6Kdb9z99+CbjC7/YXXUpncFN9x4UXZlRfaLoQECgYEA6cmAfXyf15ZBVJQN\nF/7vvlZQ6OzVL/IX3VU3xmXRXjuhS+TQ8LeUYRXzv0j9wqmsmvCg+ZQ6iSCx2IRJ\nccNGYm28fRx3bpnUtZjM+6/8xU3QljhB+2A5oldE9zhUUAuB/gMgqbVKvUEinBWQ\nJXT8ub5Qyfik+olEHYfQbNwn50UCgYEAxnqLaVsZl49+bJb88J2+vpieB0rrI/rx\n3xB8dEY5+Lbu4McWhpbnwjrE7aSdCKqc+NsZBiHQ0AL9N5QsOdAFEZZ5nWfSwJrS\ne8vH95IcPNuzxfv4D/3Ls0u6fUxhYAU4mN+Ws62Y4kXa+TpMUXr8WyVhLv6I1fNZ\nI6Dv1MINj+ECgYEAtXhC86UkEd1BEtzlGQY7pFwt68/CX7gkzBpU8/yeuu3Acz/G\n68MkOwQmMwn+Z/b60z4LRg/ILB8jzXRJ6jNw1ABoOhk5n7Fqyhc0rf1aUPDpA2Hh\n3bVAp4HkN54S3BtCqSBWX0UpIaSIr+2Q+XJIpglTfqMxtIOOSvncUFPH6Z0CgYEA\npd+2cUdcfQjEXJZXL/R1fC5qK6gWGgzYZVcO29HxEwY3X42jKrolWHLrL7xaLOsB\nowzgvfo23BETdIaV638JLWi3nLAvNx5s+F8XcLUgelAWz0jESQEPY3nPknXqD2ht\no32BIgrb8Yb1+UIalCIXk0kLDk5VJ5FnltoidYnz8aECgYBXiLqNR0JixU+M37hH\nydDE8jT0bE77QSJIi09WouTLT3eT7QBQh5FOAkCESVt6SAX+23+UscuDA9150BbI\nsLrvAwfzsh0DaqCGFf/z9e11paLiQaThxnydxh6wUy7YsBouTBZvVA4VEhV9uHEh\nCzmtEegAUPWCsJZRBSuh6Mo7cA==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:31:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Creating initial admin user... 2024-02-10T08:31:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'no1e7js2f4', 'administrator', '--force-password', '--pwd-update-required'] 2024-02-10T08:31:43.706 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin no1e7js2f4 administrator --force-password --pwd-update-required 2024-02-10T08:31:44.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:44 smithi040 bash[35794]: audit 2024-02-10T08:31:42.737220+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:31:44.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:44 smithi040 bash[35794]: audit 2024-02-10T08:31:43.271897+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271249\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271356\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:31:43.271455\", \"networks\": {}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:31:44.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:44 smithi040 bash[35794]: audit 2024-02-10T08:31:43.273601+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271249\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271356\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:31:43.271455\", \"networks\": {}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:31:44.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:44 smithi040 bash[35794]: audit 2024-02-10T08:31:43.274027+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:31:44.710 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$ONTF2HNY/Bg.99OWrA4WbuBKHRDvBtT5SR2A70evNlkY7.JT07fcu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707553904, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-10T08:31:45.422 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:45 smithi040 bash[35794]: audit 2024-02-10T08:31:44.708116+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$ONTF2HNY/Bg.99OWrA4WbuBKHRDvBtT5SR2A70evNlkY7.JT07fcu\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1707553904, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2024-02-10T08:31:45.422 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:45 smithi040 bash[35794]: audit 2024-02-10T08:31:44.709773+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$ONTF2HNY/Bg.99OWrA4WbuBKHRDvBtT5SR2A70evNlkY7.JT07fcu\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1707553904, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2024-02-10T08:31:45.876 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Fetching dashboard port number... 2024-02-10T08:31:45.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi040', '-v', '/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2024-02-10T08:31:45.877 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi040 -v /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpnpnv4cax:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpscfbw6no:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2024-02-10T08:31:46.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:46 smithi040 bash[35794]: audit 2024-02-10T08:31:44.464537+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "no1e7js2f4", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:31:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2024-02-10T08:31:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:47 smithi040 bash[35794]: audit 2024-02-10T08:31:46.647039+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.40:0/3858756319' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-10T08:31:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:47 smithi040 bash[35794]: cluster 2024-02-10T08:31:47.060577+0000 mon.a (mon.0) 98 : cluster [DBG] mgrmap e12: y(active, since 6s) 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr: URL: https://smithi040.front.sepia.ceph.com:8443/ 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr: User: admin 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr: Password: no1e7js2f4 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:You can access the Ceph CLI with: 2024-02-10T08:31:47.492 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: ceph telemetry on 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr:For more information see: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr:INFO:cephadm:Bootstrap complete. 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Releasing lock 140249587715320 on /run/cephadm/a67cbc88-c7ee-11ee-95b8-87774f69a715.lock 2024-02-10T08:31:47.493 INFO:teuthology.orchestra.run.smithi040.stderr:DEBUG:cephadm:Lock 140249587715320 released on /run/cephadm/a67cbc88-c7ee-11ee-95b8-87774f69a715.lock 2024-02-10T08:31:47.520 INFO:tasks.cephadm:Fetching config... 2024-02-10T08:31:47.521 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:31:47.521 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-10T08:31:47.540 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-10T08:31:47.540 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:31:47.540 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-10T08:31:47.599 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-10T08:31:47.600 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:31:47.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-10T08:31:47.668 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-10T08:31:47.668 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:31:47.668 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-10T08:31:47.726 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-10T08:31:47.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-10T08:31:47.803 INFO:teuthology.orchestra.run.smithi040.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:47.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-10T08:31:47.862 INFO:teuthology.orchestra.run.smithi145.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8ew+C+YK/sepRjS2gNh1TT6DbpI35PDi9iKDOJLFzZNqyultgfFDevBQbZ1eZbnNJLSontTnbtmTiI8sNMrQmifbHaH4MTMJMNk+0YhKBEONF1iUObAaWNKmskYOXxLdQFUp96re+SCINiyWlz8sKK8PGW/KHvBcIejkROOK/7VOZHx0/vByOFhD7jHYiBv2w65Fywevfp6RG2ggpWblhYqn1aOECGQEyfemPtEd3Zu71EZDLOOaYCryOvrzhCupR/DkJ7mjEr2AB7MM632qBY2PSaAbY/Co9OQ162QvT631FoMuc3zo66MhmDzU14E1i3YvGz3taOGYxiBYCv+Lk2xyMSJIyDjphxLOOlH6Bu+aHA/IMMqOO2UybMypHvUJfh1huM+OlRQQALWgG0/vq608iF1v/FJE2Kr3wSatiWrk91igw8By69MA3GzP0HeWT2ZXj6V6C/PO/xKq+a9LSA/YCBNlkCdMgHC8+R1jtpU5xQZnF0S27kw2uDaXSZIc= ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:31:47.874 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi145 2024-02-10T08:31:47.875 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:31:47.875 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.conf 2024-02-10T08:31:47.934 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:31:47.934 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:31:47.993 INFO:tasks.cephadm:Adding host smithi145 to orchestrator... 2024-02-10T08:31:47.993 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch host add smithi145 2024-02-10T08:31:49.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:49 smithi040 bash[35794]: audit 2024-02-10T08:31:49.058100+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:31:50.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:50 smithi040 bash[35794]: audit 2024-02-10T08:31:49.271729+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271249\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271356\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:31:43.271455\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:31:50.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:31:50 smithi040 bash[35794]: audit 2024-02-10T08:31:49.274180+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271249\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:31:43.271356\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:31:43.271455\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:32:01.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:01 smithi040 bash[35794]: cluster 2024-02-10T08:32:00.137020+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:03.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:03 smithi040 bash[35794]: cluster 2024-02-10T08:32:02.137394+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:05.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:05 smithi040 bash[35794]: cluster 2024-02-10T08:32:04.137783+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:07.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:07 smithi040 bash[35794]: cluster 2024-02-10T08:32:06.138196+0000 mgr.y (mgr.14140) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:09 smithi040 bash[35794]: cluster 2024-02-10T08:32:08.138548+0000 mgr.y (mgr.14140) 7 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:11.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:11 smithi040 bash[35794]: cluster 2024-02-10T08:32:10.138800+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:11.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:32:11 smithi040 bash[36026]: Warning: Permanently added 'smithi145,172.21.15.145' (ECDSA) to the list of known hosts. 2024-02-10T08:32:12.599 INFO:teuthology.orchestra.run.smithi145.stdout:Added host 'smithi145' 2024-02-10T08:32:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:12 smithi040 bash[35794]: audit 2024-02-10T08:32:12.078847+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"smithi040\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:32:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:12 smithi040 bash[35794]: audit 2024-02-10T08:32:12.080923+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"smithi040\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:32:13.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch host ls --format=json 2024-02-10T08:32:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:11.595246+0000 mgr.y (mgr.14140) 9 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: cephadm 2024-02-10T08:32:12.081376+0000 mgr.y (mgr.14140) 10 : cephadm [INF] Added host smithi145 2024-02-10T08:32:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: cluster 2024-02-10T08:32:12.139223+0000 mgr.y (mgr.14140) 11 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:12.278000+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:12.279662+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:12.280268+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:32:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:12.453741+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:32:12.453453\", \"networks\": {}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:12.455482+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:32:12.453453\", \"networks\": {}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:13 smithi040 bash[35794]: audit 2024-02-10T08:32:12.456014+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:32:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:15 smithi040 bash[35794]: cluster 2024-02-10T08:32:14.139471+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:16.630 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:32:16.630 INFO:teuthology.orchestra.run.smithi145.stdout:[{"addr": "smithi040", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "smithi145", "hostname": "smithi145", "labels": [], "status": ""}] 2024-02-10T08:32:17.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:17 smithi040 bash[35794]: cluster 2024-02-10T08:32:16.139826+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:17 smithi040 bash[35794]: audit 2024-02-10T08:32:16.942014+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:32:17.645 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-10T08:32:17.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd crush tunables default 2024-02-10T08:32:18.413 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:18 smithi040 bash[35794]: audit 2024-02-10T08:32:16.628759+0000 mgr.y (mgr.14140) 14 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:32:18.413 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:18 smithi040 bash[35794]: audit 2024-02-10T08:32:17.125012+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:32:12.453453\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:18.413 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:18 smithi040 bash[35794]: audit 2024-02-10T08:32:17.126631+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-10T08:32:12.453453\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:19.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:19 smithi040 bash[35794]: cluster 2024-02-10T08:32:18.140119+0000 mgr.y (mgr.14140) 15 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:20.076 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-02-10T08:32:20.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:20 smithi040 bash[35794]: audit 2024-02-10T08:32:19.772223+0000 mon.a (mon.0) 113 : audit [INF] from='client.? 172.21.15.40:0/504927073' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-10T08:32:20.939 INFO:tasks.cephadm:Adding mon.c on smithi040 2024-02-10T08:32:20.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add mon 'smithi040:[v2:172.21.15.40:3301,v1:172.21.15.40:6790]=c' 2024-02-10T08:32:21.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:21 smithi040 bash[35794]: audit 2024-02-10T08:32:20.073264+0000 mon.a (mon.0) 114 : audit [INF] from='client.? 172.21.15.40:0/504927073' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-10T08:32:21.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:21 smithi040 bash[35794]: cluster 2024-02-10T08:32:20.073297+0000 mon.a (mon.0) 115 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-10T08:32:21.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:21 smithi040 bash[35794]: cluster 2024-02-10T08:32:20.140400+0000 mgr.y (mgr.14140) 16 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:23.496 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:23 smithi040 bash[35794]: cluster 2024-02-10T08:32:22.140742+0000 mgr.y (mgr.14140) 17 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:23.496 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:23 smithi040 bash[35794]: audit 2024-02-10T08:32:23.060214+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:32:23.496 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:23 smithi040 bash[35794]: audit 2024-02-10T08:32:23.060857+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:23.496 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:23 smithi040 bash[35794]: audit 2024-02-10T08:32:23.061461+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-10T08:32:24.541 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:24 smithi040 bash[35794]: audit 2024-02-10T08:32:23.058600+0000 mgr.y (mgr.14140) 18 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi040:[v2:172.21.15.40:3301,v1:172.21.15.40:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:24.541 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:24 smithi040 bash[35794]: cephadm 2024-02-10T08:32:23.061264+0000 mgr.y (mgr.14140) 19 : cephadm [INF] Deploying daemon mon.c on smithi040 2024-02-10T08:32:25.525 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:25 smithi040 bash[35794]: cluster 2024-02-10T08:32:24.141132+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi040.stdout:Deployed mon.c on host 'smithi040' 2024-02-10T08:32:27.763 DEBUG:teuthology.orchestra.run.smithi040:mon.c> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.c.service 2024-02-10T08:32:27.765 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-10T08:32:27.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph mon dump -f json 2024-02-10T08:32:27.796 INFO:journalctl@ceph.mon.c.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:32:32.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:26.687185+0000 mon.a (mon.0) 122 : cluster [INF] mon.a calling monitor election 2024-02-10T08:32:32.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:28.141794+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:32.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:26.687185+0000 mon.a (mon.0) 122 : cluster [INF] mon.a calling monitor election 2024-02-10T08:32:32.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:28.141794+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:32.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: audit 2024-02-10T08:32:28.317964+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317327\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}}, \"last_daemon_update\": \"2024-02-10T08:32:28.317432\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:32:32.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:28.685883+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-10T08:32:32.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:30.142259+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:32.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:31.712962+0000 mon.a (mon.0) 124 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:31.716583+0000 mon.a (mon.0) 125 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:31.716649+0000 mon.a (mon.0) 126 : cluster [DBG] fsmap 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:31.716695+0000 mon.a (mon.0) 127 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:31.716983+0000 mon.a (mon.0) 128 : cluster [DBG] mgrmap e12: y(active, since 51s) 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: audit 2024-02-10T08:32:31.717886+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317327\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}}, \"last_daemon_update\": \"2024-02-10T08:32:28.317432\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: cluster 2024-02-10T08:32:31.719974+0000 mon.a (mon.0) 130 : cluster [INF] overall HEALTH_OK 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[35794]: audit 2024-02-10T08:32:31.722071+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317327\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}}, \"last_daemon_update\": \"2024-02-10T08:32:28.317432\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: audit 2024-02-10T08:32:28.317964+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317327\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}}, \"last_daemon_update\": \"2024-02-10T08:32:28.317432\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:28.685883+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-10T08:32:32.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:30.142259+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:31.712962+0000 mon.a (mon.0) 124 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:31.716583+0000 mon.a (mon.0) 125 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:31.716649+0000 mon.a (mon.0) 126 : cluster [DBG] fsmap 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:31.716695+0000 mon.a (mon.0) 127 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:31.716983+0000 mon.a (mon.0) 128 : cluster [DBG] mgrmap e12: y(active, since 51s) 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: audit 2024-02-10T08:32:31.717886+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317327\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}}, \"last_daemon_update\": \"2024-02-10T08:32:28.317432\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: cluster 2024-02-10T08:32:31.719974+0000 mon.a (mon.0) 130 : cluster [INF] overall HEALTH_OK 2024-02-10T08:32:32.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:31 smithi040 bash[38951]: audit 2024-02-10T08:32:31.722071+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317327\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}}, \"last_daemon_update\": \"2024-02-10T08:32:28.317432\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:32:32.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:32:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"fsid":"a67cbc88-c7ee-11ee-95b8-87774f69a715","modified":"2024-02-10T08:32:26.685222Z","created":"2024-02-10T08:30:56.662646Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3301","nonce":0},{"type":"v1","addr":"172.21.15.40:6790","nonce":0}]},"addr":"172.21.15.40:6790/0","public_addr":"172.21.15.40:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-02-10T08:32:32.429 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 2 2024-02-10T08:32:33.057 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:32 smithi040 bash[35794]: cluster 2024-02-10T08:32:32.142609+0000 mgr.y (mgr.14140) 24 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:33.057 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:32 smithi040 bash[35794]: audit 2024-02-10T08:32:32.427543+0000 mon.a (mon.0) 132 : audit [DBG] from='client.? 172.21.15.40:0/2000430257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:32:33.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:32 smithi040 bash[38951]: cluster 2024-02-10T08:32:32.142609+0000 mgr.y (mgr.14140) 24 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:33.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:32 smithi040 bash[38951]: audit 2024-02-10T08:32:32.427543+0000 mon.a (mon.0) 132 : audit [DBG] from='client.? 172.21.15.40:0/2000430257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:32:33.070 INFO:tasks.cephadm:Adding mon.b on smithi145 2024-02-10T08:32:33.070 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add mon smithi145:172.21.15.145=b 2024-02-10T08:32:35.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:35 smithi040 bash[35794]: cluster 2024-02-10T08:32:34.142930+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:35 smithi040 bash[38951]: cluster 2024-02-10T08:32:34.142930+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:36.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:36 smithi040 bash[35794]: audit 2024-02-10T08:32:36.056723+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:32:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:36 smithi040 bash[35794]: audit 2024-02-10T08:32:36.057492+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:36 smithi040 bash[35794]: audit 2024-02-10T08:32:36.058356+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-10T08:32:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:36 smithi040 bash[38951]: audit 2024-02-10T08:32:36.056723+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:32:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:36 smithi040 bash[38951]: audit 2024-02-10T08:32:36.057492+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:36 smithi040 bash[38951]: audit 2024-02-10T08:32:36.058356+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-10T08:32:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:37 smithi040 bash[35794]: audit 2024-02-10T08:32:36.055354+0000 mgr.y (mgr.14140) 26 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi145:172.21.15.145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:37 smithi040 bash[35794]: cephadm 2024-02-10T08:32:36.058081+0000 mgr.y (mgr.14140) 27 : cephadm [INF] Deploying daemon mon.b on smithi145 2024-02-10T08:32:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:37 smithi040 bash[35794]: cluster 2024-02-10T08:32:36.143301+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:37 smithi040 bash[38951]: audit 2024-02-10T08:32:36.055354+0000 mgr.y (mgr.14140) 26 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi145:172.21.15.145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:37 smithi040 bash[38951]: cephadm 2024-02-10T08:32:36.058081+0000 mgr.y (mgr.14140) 27 : cephadm [INF] Deploying daemon mon.b on smithi145 2024-02-10T08:32:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:37 smithi040 bash[38951]: cluster 2024-02-10T08:32:36.143301+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:39.062 INFO:teuthology.orchestra.run.smithi145.stdout:Deployed mon.b on host 'smithi145' 2024-02-10T08:32:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[35794]: cluster 2024-02-10T08:32:38.143600+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[35794]: audit 2024-02-10T08:32:39.037213+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[35794]: audit 2024-02-10T08:32:39.037659+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:32:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[35794]: audit 2024-02-10T08:32:39.039748+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[38951]: cluster 2024-02-10T08:32:38.143600+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[38951]: audit 2024-02-10T08:32:39.037213+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:39.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[38951]: audit 2024-02-10T08:32:39.037659+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:32:39.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:39 smithi040 bash[38951]: audit 2024-02-10T08:32:39.039748+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:40 smithi040 bash[35794]: cluster 2024-02-10T08:32:40.143956+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:40 smithi040 bash[35794]: cluster 2024-02-10T08:32:40.202550+0000 mon.a (mon.0) 139 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-10T08:32:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:40 smithi040 bash[38951]: cluster 2024-02-10T08:32:40.143956+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:40 smithi040 bash[38951]: cluster 2024-02-10T08:32:40.202550+0000 mon.a (mon.0) 139 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-10T08:32:42.817 DEBUG:teuthology.orchestra.run.smithi145:mon.b> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.b.service 2024-02-10T08:32:42.819 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-10T08:32:42.820 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph mon dump -f json 2024-02-10T08:32:42.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:32:46.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:40.793209+0000 mon.a (mon.0) 140 : cluster [INF] mon.a calling monitor election 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:40.798561+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:42.144349+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:42.790963+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:44.144710+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:45.819806+0000 mon.a (mon.0) 141 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:45.824085+0000 mon.a (mon.0) 142 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:45.824136+0000 mon.a (mon.0) 143 : cluster [DBG] fsmap 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:45.824164+0000 mon.a (mon.0) 144 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:45.824363+0000 mon.a (mon.0) 145 : cluster [DBG] mgrmap e12: y(active, since 65s) 2024-02-10T08:32:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[35794]: cluster 2024-02-10T08:32:45.832632+0000 mon.a (mon.0) 146 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:40.793209+0000 mon.a (mon.0) 140 : cluster [INF] mon.a calling monitor election 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:40.798561+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:42.144349+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:42.790963+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:44.144710+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:45.819806+0000 mon.a (mon.0) 141 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:45.824085+0000 mon.a (mon.0) 142 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:45.824136+0000 mon.a (mon.0) 143 : cluster [DBG] fsmap 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:45.824164+0000 mon.a (mon.0) 144 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:45.824363+0000 mon.a (mon.0) 145 : cluster [DBG] mgrmap e12: y(active, since 65s) 2024-02-10T08:32:46.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:45 smithi040 bash[38951]: cluster 2024-02-10T08:32:45.832632+0000 mon.a (mon.0) 146 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:40.793209+0000 mon.a (mon.0) 140 : cluster [INF] mon.a calling monitor election 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:40.798561+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:42.144349+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:42.790963+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:44.144710+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:45.819806+0000 mon.a (mon.0) 141 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:45.824085+0000 mon.a (mon.0) 142 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:45.824136+0000 mon.a (mon.0) 143 : cluster [DBG] fsmap 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:45.824164+0000 mon.a (mon.0) 144 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:45.824363+0000 mon.a (mon.0) 145 : cluster [DBG] mgrmap e12: y(active, since 65s) 2024-02-10T08:32:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:45 smithi145 bash[35820]: cluster 2024-02-10T08:32:45.832632+0000 mon.a (mon.0) 146 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-10T08:32:47.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:47 smithi040 bash[35794]: cluster 2024-02-10T08:32:46.145056+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:47.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:47 smithi040 bash[38951]: cluster 2024-02-10T08:32:46.145056+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:47 smithi145 bash[35820]: cluster 2024-02-10T08:32:46.145056+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:49 smithi145 bash[35820]: cluster 2024-02-10T08:32:48.145392+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:49 smithi145 bash[35820]: audit 2024-02-10T08:32:49.044161+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_daemon_update\": \"2024-02-10T08:32:49.043616\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:49 smithi145 bash[35820]: audit 2024-02-10T08:32:49.047234+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_daemon_update\": \"2024-02-10T08:32:49.043616\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:49.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:49 smithi040 bash[35794]: cluster 2024-02-10T08:32:48.145392+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:49.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:49 smithi040 bash[35794]: audit 2024-02-10T08:32:49.044161+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_daemon_update\": \"2024-02-10T08:32:49.043616\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:49.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:49 smithi040 bash[35794]: audit 2024-02-10T08:32:49.047234+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_daemon_update\": \"2024-02-10T08:32:49.043616\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:49 smithi040 bash[38951]: cluster 2024-02-10T08:32:48.145392+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:49 smithi040 bash[38951]: audit 2024-02-10T08:32:49.044161+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_daemon_update\": \"2024-02-10T08:32:49.043616\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:49 smithi040 bash[38951]: audit 2024-02-10T08:32:49.047234+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}}, \"last_daemon_update\": \"2024-02-10T08:32:49.043616\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:50.564 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-02-10T08:32:50.564 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":3,"fsid":"a67cbc88-c7ee-11ee-95b8-87774f69a715","modified":"2024-02-10T08:32:40.789705Z","created":"2024-02-10T08:30:56.662646Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3301","nonce":0},{"type":"v1","addr":"172.21.15.40:6790","nonce":0}]},"addr":"172.21.15.40:6790/0","public_addr":"172.21.15.40:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2024-02-10T08:32:50.565 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 3 2024-02-10T08:32:51.264 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-10T08:32:51.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph config generate-minimal-conf 2024-02-10T08:32:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:51 smithi145 bash[35820]: cluster 2024-02-10T08:32:50.145701+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:51 smithi145 bash[35820]: audit 2024-02-10T08:32:50.563393+0000 mon.a (mon.0) 149 : audit [DBG] from='client.? 172.21.15.145:0/4149683948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:32:51.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:51 smithi040 bash[35794]: cluster 2024-02-10T08:32:50.145701+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:51.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:51 smithi040 bash[35794]: audit 2024-02-10T08:32:50.563393+0000 mon.a (mon.0) 149 : audit [DBG] from='client.? 172.21.15.145:0/4149683948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:32:51.653 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:51 smithi040 bash[38951]: cluster 2024-02-10T08:32:50.145701+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:51.653 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:51 smithi040 bash[38951]: audit 2024-02-10T08:32:50.563393+0000 mon.a (mon.0) 149 : audit [DBG] from='client.? 172.21.15.145:0/4149683948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-10T08:32:53.340 INFO:teuthology.orchestra.run.smithi040.stdout:# minimal ceph.conf for a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:32:53.341 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-02-10T08:32:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:32:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: mon_host = [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] 2024-02-10T08:32:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:53 smithi145 bash[35820]: cluster 2024-02-10T08:32:52.146130+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:53 smithi040 bash[35794]: cluster 2024-02-10T08:32:52.146130+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:53 smithi040 bash[38951]: cluster 2024-02-10T08:32:52.146130+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:54.097 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-10T08:32:54.097 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:32:54.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.conf 2024-02-10T08:32:54.131 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:32:54.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:32:54.199 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:32:54.200 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.conf 2024-02-10T08:32:54.238 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:32:54.238 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-10T08:32:54.308 INFO:tasks.cephadm:Adding mgr.y on smithi040 2024-02-10T08:32:54.308 INFO:tasks.cephadm:Adding mgr.x on smithi145 2024-02-10T08:32:54.309 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch apply mgr '2;smithi040=y;smithi145=x' 2024-02-10T08:32:54.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:54 smithi040 bash[35794]: audit 2024-02-10T08:32:53.340437+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.40:0/3166460160' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:54.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:54 smithi040 bash[38951]: audit 2024-02-10T08:32:53.340437+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.40:0/3166460160' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:54.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:54 smithi145 bash[35820]: audit 2024-02-10T08:32:53.340437+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.40:0/3166460160' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:55.489 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:55 smithi145 bash[35820]: cluster 2024-02-10T08:32:54.146411+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:55 smithi040 bash[35794]: cluster 2024-02-10T08:32:54.146411+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:55 smithi040 bash[38951]: cluster 2024-02-10T08:32:54.146411+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:56.446 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mgr update... 2024-02-10T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: cluster 2024-02-10T08:32:56.146905+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: audit 2024-02-10T08:32:56.440982+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-10T08:32:56.440583\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-10T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: audit 2024-02-10T08:32:56.444056+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-10T08:32:56.440583\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-10T08:32:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: audit 2024-02-10T08:32:56.445491+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:32:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: audit 2024-02-10T08:32:56.448653+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-10T08:32:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: audit 2024-02-10T08:32:56.449528+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:57 smithi145 bash[35820]: audit 2024-02-10T08:32:56.450615+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-10T08:32:57.422 DEBUG:teuthology.orchestra.run.smithi145:mgr.x> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x.service 2024-02-10T08:32:57.424 INFO:tasks.cephadm:Deploying OSDs... 2024-02-10T08:32:57.425 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:32:57.425 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: cluster 2024-02-10T08:32:56.146905+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: audit 2024-02-10T08:32:56.440982+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-10T08:32:56.440583\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: audit 2024-02-10T08:32:56.444056+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-10T08:32:56.440583\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: audit 2024-02-10T08:32:56.445491+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: audit 2024-02-10T08:32:56.448653+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: audit 2024-02-10T08:32:56.449528+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[35794]: audit 2024-02-10T08:32:56.450615+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: cluster 2024-02-10T08:32:56.146905+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: audit 2024-02-10T08:32:56.440982+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-10T08:32:56.440583\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: audit 2024-02-10T08:32:56.444056+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-10T08:32:56.440583\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: audit 2024-02-10T08:32:56.445491+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: audit 2024-02-10T08:32:56.448653+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: audit 2024-02-10T08:32:56.449528+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:32:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:57 smithi040 bash[38951]: audit 2024-02-10T08:32:56.450615+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-10T08:32:57.450 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-10T08:32:57.450 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-02-10T08:32:57.454 INFO:journalctl@ceph.mgr.x.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:32:57.512 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-10T08:32:57.512 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:57.512 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 164286 Links: 1 2024-02-10T08:32:57.512 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:57.512 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:57.512 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-10 08:32:26.148368205 +0000 2024-02-10T08:32:57.513 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-10 08:28:29.131034873 +0000 2024-02-10T08:32:57.513 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-10 08:28:29.131034873 +0000 2024-02-10T08:32:57.513 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-10T08:32:57.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-10T08:32:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-10T08:32:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-10T08:32:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000276057 s, 1.9 MB/s 2024-02-10T08:32:57.586 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-10T08:32:57.648 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-02-10T08:32:57.708 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 166467 Links: 1 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-10 08:32:26.148368205 +0000 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-10 08:28:29.477030558 +0000 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-10 08:28:29.477030558 +0000 2024-02-10T08:32:57.709 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-10T08:32:57.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-10T08:32:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-10T08:32:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-10T08:32:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000243391 s, 2.1 MB/s 2024-02-10T08:32:57.780 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-10T08:32:57.841 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 165424 Links: 1 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-10 08:32:26.148368205 +0000 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-10 08:28:29.841026018 +0000 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-10 08:28:29.841026018 +0000 2024-02-10T08:32:57.902 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-10T08:32:57.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-10T08:32:57.970 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-10T08:32:57.970 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-10T08:32:57.971 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000171929 s, 3.0 MB/s 2024-02-10T08:32:57.972 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-10T08:32:58.032 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-02-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 166572 Links: 1 2024-02-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-02-10 08:32:26.148368205 +0000 2024-02-10T08:32:58.094 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-02-10 08:28:30.185021729 +0000 2024-02-10T08:32:58.094 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-02-10 08:28:30.185021729 +0000 2024-02-10T08:32:58.094 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-02-10T08:32:58.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-10T08:32:58.161 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-02-10T08:32:58.162 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-02-10T08:32:58.162 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.00023456 s, 2.2 MB/s 2024-02-10T08:32:58.163 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-10T08:32:58.224 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:32:58.224 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-02-10T08:32:58.242 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-10T08:32:58.242 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-02-10T08:32:58.301 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 164331 Links: 1 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-02-10 08:32:58.238532577 +0000 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-02-10 08:28:13.930675234 +0000 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-02-10 08:28:13.930675234 +0000 2024-02-10T08:32:58.302 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-02-10T08:32:58.302 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-10T08:32:58.404 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:58 smithi145 bash[35820]: audit 2024-02-10T08:32:56.439908+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi040=y;smithi145=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:58.404 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:58 smithi145 bash[35820]: cephadm 2024-02-10T08:32:56.440562+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi040=y,smithi145=x 2024-02-10T08:32:58.404 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:58 smithi145 bash[35820]: cephadm 2024-02-10T08:32:56.450173+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:32:58.407 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-02-10T08:32:58.407 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-02-10T08:32:58.407 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000240185 s, 2.1 MB/s 2024-02-10T08:32:58.409 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-10T08:32:58.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:58 smithi040 bash[38951]: audit 2024-02-10T08:32:56.439908+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi040=y;smithi145=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:58.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:58 smithi040 bash[38951]: cephadm 2024-02-10T08:32:56.440562+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi040=y,smithi145=x 2024-02-10T08:32:58.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:58 smithi040 bash[38951]: cephadm 2024-02-10T08:32:56.450173+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:32:58.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:58 smithi040 bash[35794]: audit 2024-02-10T08:32:56.439908+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi040=y;smithi145=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:32:58.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:58 smithi040 bash[35794]: cephadm 2024-02-10T08:32:56.440562+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi040=y,smithi145=x 2024-02-10T08:32:58.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:58 smithi040 bash[35794]: cephadm 2024-02-10T08:32:56.450173+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:32:58.429 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 166396 Links: 1 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-02-10 08:32:58.360529998 +0000 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-02-10 08:28:14.265668231 +0000 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-02-10 08:28:14.265668231 +0000 2024-02-10T08:32:58.489 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-02-10T08:32:58.490 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-10T08:32:58.556 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-02-10T08:32:58.556 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-02-10T08:32:58.556 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000194822 s, 2.6 MB/s 2024-02-10T08:32:58.557 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-10T08:32:58.617 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-02-10T08:32:58.676 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-10T08:32:58.676 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:58.676 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 170175 Links: 1 2024-02-10T08:32:58.676 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:58.677 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:58.677 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-02-10 08:32:58.360529998 +0000 2024-02-10T08:32:58.677 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-02-10 08:28:14.617660873 +0000 2024-02-10T08:32:58.677 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-02-10 08:28:14.617660873 +0000 2024-02-10T08:32:58.677 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-02-10T08:32:58.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-10T08:32:58.741 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:32:58 smithi145 podman[36627]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x" found: no such container 2024-02-10T08:32:58.741 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:32:58 smithi145 systemd[1]: Started Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:32:58.743 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-02-10T08:32:58.743 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-02-10T08:32:58.743 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000199426 s, 2.6 MB/s 2024-02-10T08:32:58.744 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-10T08:32:58.804 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 169439 Links: 1 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-02-10 08:32:58.360529998 +0000 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-02-10 08:28:14.967653557 +0000 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-02-10 08:28:14.967653557 +0000 2024-02-10T08:32:58.862 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-02-10T08:32:58.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-10T08:32:58.928 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-02-10T08:32:58.929 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-02-10T08:32:58.929 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000228325 s, 2.2 MB/s 2024-02-10T08:32:58.930 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-10T08:32:58.988 INFO:tasks.cephadm:Deploying osd.0 on smithi040 with /dev/vg_nvme/lv_4... 2024-02-10T08:32:58.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-10T08:32:59.378 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[35794]: cluster 2024-02-10T08:32:58.147191+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[35794]: audit 2024-02-10T08:32:58.468554+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[38951]: cluster 2024-02-10T08:32:58.147191+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[38951]: audit 2024-02-10T08:32:58.468554+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[38951]: audit 2024-02-10T08:32:58.471751+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[38951]: audit 2024-02-10T08:32:58.472369+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[35794]: audit 2024-02-10T08:32:58.471751+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:59.379 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:32:59 smithi040 bash[35794]: audit 2024-02-10T08:32:58.472369+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:32:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:59 smithi145 bash[35820]: cluster 2024-02-10T08:32:58.147191+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:32:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:59 smithi145 bash[35820]: audit 2024-02-10T08:32:58.468554+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:32:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:59 smithi145 bash[35820]: audit 2024-02-10T08:32:58.471751+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:49.043470\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:32:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:32:59 smithi145 bash[35820]: audit 2024-02-10T08:32:58.472369+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:00.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[35794]: audit 2024-02-10T08:32:59.953522+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_daemon_update\": \"2024-02-10T08:32:59.953003\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:33:00.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[35794]: audit 2024-02-10T08:32:59.955931+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_daemon_update\": \"2024-02-10T08:32:59.953003\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:33:00.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[35794]: audit 2024-02-10T08:32:59.956951+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-10T08:33:00.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[35794]: audit 2024-02-10T08:32:59.957543+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:00.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[35794]: audit 2024-02-10T08:32:59.958309+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-10T08:33:00.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[38951]: audit 2024-02-10T08:32:59.953522+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_daemon_update\": \"2024-02-10T08:32:59.953003\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:33:00.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[38951]: audit 2024-02-10T08:32:59.955931+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_daemon_update\": \"2024-02-10T08:32:59.953003\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:33:00.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[38951]: audit 2024-02-10T08:32:59.956951+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-10T08:33:00.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[38951]: audit 2024-02-10T08:32:59.957543+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:00.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:00 smithi040 bash[38951]: audit 2024-02-10T08:32:59.958309+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-10T08:33:00.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:00 smithi145 bash[35820]: audit 2024-02-10T08:32:59.953522+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_daemon_update\": \"2024-02-10T08:32:59.953003\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:33:00.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:00 smithi145 bash[35820]: audit 2024-02-10T08:32:59.955931+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}}, \"last_daemon_update\": \"2024-02-10T08:32:59.953003\", \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:33:00.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:00 smithi145 bash[35820]: audit 2024-02-10T08:32:59.956951+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-10T08:33:00.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:00 smithi145 bash[35820]: audit 2024-02-10T08:32:59.957543+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:00.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:00 smithi145 bash[35820]: audit 2024-02-10T08:32:59.958309+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-10T08:33:01.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:01 smithi040 bash[35794]: cephadm 2024-02-10T08:32:59.956758+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-10T08:33:01.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:01 smithi040 bash[35794]: cephadm 2024-02-10T08:32:59.958026+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-10T08:33:01.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:01 smithi040 bash[35794]: cluster 2024-02-10T08:33:00.147473+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:01.381 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:01 smithi040 bash[38951]: cephadm 2024-02-10T08:32:59.956758+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-10T08:33:01.381 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:01 smithi040 bash[38951]: cephadm 2024-02-10T08:32:59.958026+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-10T08:33:01.381 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:01 smithi040 bash[38951]: cluster 2024-02-10T08:33:00.147473+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:01 smithi145 bash[35820]: cephadm 2024-02-10T08:32:59.956758+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-10T08:33:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:01 smithi145 bash[35820]: cephadm 2024-02-10T08:32:59.958026+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-10T08:33:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:01 smithi145 bash[35820]: cluster 2024-02-10T08:33:00.147473+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-10T08:33:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-10T08:33:01.840 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-10T08:33:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-10T08:33:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107893 s, 972 MB/s 2024-02-10T08:33:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-10T08:33:02.366 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:02 smithi040 bash[35794]: audit 2024-02-10T08:33:01.691098+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:02.366 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:02 smithi040 bash[35794]: audit 2024-02-10T08:33:01.693530+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:02.366 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:02 smithi040 bash[35794]: audit 2024-02-10T08:33:01.694131+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:02.367 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:02 smithi040 bash[38951]: audit 2024-02-10T08:33:01.691098+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:02.367 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:02 smithi040 bash[38951]: audit 2024-02-10T08:33:01.693530+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:02.367 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:02 smithi040 bash[38951]: audit 2024-02-10T08:33:01.694131+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:02.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_4 2024-02-10T08:33:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:02 smithi145 bash[35820]: audit 2024-02-10T08:33:01.691098+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:02 smithi145 bash[35820]: audit 2024-02-10T08:33:01.693530+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317248\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:28.317360\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:02 smithi145 bash[35820]: audit 2024-02-10T08:33:01.694131+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:03.101 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[38951]: cluster 2024-02-10T08:33:02.147807+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:03.102 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[38951]: cluster 2024-02-10T08:33:02.982865+0000 mon.a (mon.0) 168 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:33:03.102 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[38951]: audit 2024-02-10T08:33:02.983732+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.145:0/161071374' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:33:03.102 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[38951]: audit 2024-02-10T08:33:02.984636+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.145:0/161071374' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:33:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[35794]: cluster 2024-02-10T08:33:02.147807+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[35794]: cluster 2024-02-10T08:33:02.982865+0000 mon.a (mon.0) 168 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:33:03.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[35794]: audit 2024-02-10T08:33:02.983732+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.145:0/161071374' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:33:03.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:03 smithi040 bash[35794]: audit 2024-02-10T08:33:02.984636+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.145:0/161071374' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:33:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:03 smithi145 bash[35820]: cluster 2024-02-10T08:33:02.147807+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:03 smithi145 bash[35820]: cluster 2024-02-10T08:33:02.982865+0000 mon.a (mon.0) 168 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:33:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:03 smithi145 bash[35820]: audit 2024-02-10T08:33:02.983732+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.145:0/161071374' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:33:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:03 smithi145 bash[35820]: audit 2024-02-10T08:33:02.984636+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.145:0/161071374' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:33:04.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:04 smithi040 bash[35794]: cluster 2024-02-10T08:33:03.103998+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 83s), standbys: x 2024-02-10T08:33:04.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:04 smithi040 bash[35794]: audit 2024-02-10T08:33:03.104103+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:33:04.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:04 smithi040 bash[38951]: cluster 2024-02-10T08:33:03.103998+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 83s), standbys: x 2024-02-10T08:33:04.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:04 smithi040 bash[38951]: audit 2024-02-10T08:33:03.104103+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:33:04.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:04 smithi145 bash[35820]: cluster 2024-02-10T08:33:03.103998+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 83s), standbys: x 2024-02-10T08:33:04.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:04 smithi145 bash[35820]: audit 2024-02-10T08:33:03.104103+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:33:05.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[38951]: cluster 2024-02-10T08:33:04.148129+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:05.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[35794]: cluster 2024-02-10T08:33:04.148129+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:05.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[38951]: audit 2024-02-10T08:33:04.574031+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_daemon_update\": \"2024-02-10T08:33:04.573273\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:05.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[38951]: audit 2024-02-10T08:33:04.577348+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_daemon_update\": \"2024-02-10T08:33:04.573273\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:05.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[38951]: audit 2024-02-10T08:33:04.979158+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:05.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[38951]: audit 2024-02-10T08:33:04.979698+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:05.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[38951]: audit 2024-02-10T08:33:04.980358+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[35794]: audit 2024-02-10T08:33:04.574031+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_daemon_update\": \"2024-02-10T08:33:04.573273\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[35794]: audit 2024-02-10T08:33:04.577348+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_daemon_update\": \"2024-02-10T08:33:04.573273\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[35794]: audit 2024-02-10T08:33:04.979158+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[35794]: audit 2024-02-10T08:33:04.979698+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:05 smithi040 bash[35794]: audit 2024-02-10T08:33:04.980358+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:05.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:05 smithi145 bash[35820]: cluster 2024-02-10T08:33:04.148129+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:05 smithi145 bash[35820]: audit 2024-02-10T08:33:04.574031+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_daemon_update\": \"2024-02-10T08:33:04.573273\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:05 smithi145 bash[35820]: audit 2024-02-10T08:33:04.577348+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}}, \"last_daemon_update\": \"2024-02-10T08:33:04.573273\", \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:05 smithi145 bash[35820]: audit 2024-02-10T08:33:04.979158+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:05 smithi145 bash[35820]: audit 2024-02-10T08:33:04.979698+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:05 smithi145 bash[35820]: audit 2024-02-10T08:33:04.980358+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:06.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:06 smithi040 bash[35794]: audit 2024-02-10T08:33:04.978083+0000 mgr.y (mgr.14140) 48 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:06.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:06 smithi040 bash[35794]: cephadm 2024-02-10T08:33:04.978876+0000 mgr.y (mgr.14140) 49 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:06.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:06 smithi040 bash[38951]: audit 2024-02-10T08:33:04.978083+0000 mgr.y (mgr.14140) 48 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:06.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:06 smithi040 bash[38951]: cephadm 2024-02-10T08:33:04.978876+0000 mgr.y (mgr.14140) 49 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:06 smithi145 bash[35820]: audit 2024-02-10T08:33:04.978083+0000 mgr.y (mgr.14140) 48 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:06 smithi145 bash[35820]: cephadm 2024-02-10T08:33:04.978876+0000 mgr.y (mgr.14140) 49 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:07 smithi040 bash[35794]: cluster 2024-02-10T08:33:06.148371+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:07 smithi040 bash[38951]: cluster 2024-02-10T08:33:06.148371+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:07 smithi145 bash[35820]: cluster 2024-02-10T08:33:06.148371+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:08.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[35794]: audit 2024-02-10T08:33:07.545212+0000 mon.a (mon.0) 176 : audit [INF] from='client.? 172.21.15.40:0/1911276866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "066f4269-9cf7-4480-8575-a2fcf6a72404"}]: dispatch 2024-02-10T08:33:08.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[35794]: audit 2024-02-10T08:33:07.551633+0000 mon.a (mon.0) 177 : audit [INF] from='client.? 172.21.15.40:0/1911276866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "066f4269-9cf7-4480-8575-a2fcf6a72404"}]': finished 2024-02-10T08:33:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[35794]: cluster 2024-02-10T08:33:07.551669+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-10T08:33:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[35794]: audit 2024-02-10T08:33:07.551780+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[38951]: audit 2024-02-10T08:33:07.545212+0000 mon.a (mon.0) 176 : audit [INF] from='client.? 172.21.15.40:0/1911276866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "066f4269-9cf7-4480-8575-a2fcf6a72404"}]: dispatch 2024-02-10T08:33:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[38951]: audit 2024-02-10T08:33:07.551633+0000 mon.a (mon.0) 177 : audit [INF] from='client.? 172.21.15.40:0/1911276866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "066f4269-9cf7-4480-8575-a2fcf6a72404"}]': finished 2024-02-10T08:33:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[38951]: cluster 2024-02-10T08:33:07.551669+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-10T08:33:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:08 smithi040 bash[38951]: audit 2024-02-10T08:33:07.551780+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:08 smithi145 bash[35820]: audit 2024-02-10T08:33:07.545212+0000 mon.a (mon.0) 176 : audit [INF] from='client.? 172.21.15.40:0/1911276866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "066f4269-9cf7-4480-8575-a2fcf6a72404"}]: dispatch 2024-02-10T08:33:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:08 smithi145 bash[35820]: audit 2024-02-10T08:33:07.551633+0000 mon.a (mon.0) 177 : audit [INF] from='client.? 172.21.15.40:0/1911276866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "066f4269-9cf7-4480-8575-a2fcf6a72404"}]': finished 2024-02-10T08:33:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:08 smithi145 bash[35820]: cluster 2024-02-10T08:33:07.551669+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-10T08:33:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:08 smithi145 bash[35820]: audit 2024-02-10T08:33:07.551780+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:09 smithi040 bash[35794]: cluster 2024-02-10T08:33:08.148640+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:09 smithi040 bash[35794]: audit 2024-02-10T08:33:08.346807+0000 mon.a (mon.0) 180 : audit [DBG] from='client.? 172.21.15.40:0/3237121130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:09 smithi040 bash[38951]: cluster 2024-02-10T08:33:08.148640+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:09 smithi040 bash[38951]: audit 2024-02-10T08:33:08.346807+0000 mon.a (mon.0) 180 : audit [DBG] from='client.? 172.21.15.40:0/3237121130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:09 smithi145 bash[35820]: cluster 2024-02-10T08:33:08.148640+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:09 smithi145 bash[35820]: audit 2024-02-10T08:33:08.346807+0000 mon.a (mon.0) 180 : audit [DBG] from='client.? 172.21.15.40:0/3237121130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:11.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:11 smithi040 bash[35794]: cluster 2024-02-10T08:33:10.149037+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:11.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:11 smithi040 bash[35794]: audit 2024-02-10T08:33:10.958444+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:11.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:11 smithi040 bash[38951]: cluster 2024-02-10T08:33:10.149037+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:11.459 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:11 smithi040 bash[38951]: audit 2024-02-10T08:33:10.958444+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:11 smithi145 bash[35820]: cluster 2024-02-10T08:33:10.149037+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:11 smithi145 bash[35820]: audit 2024-02-10T08:33:10.958444+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:13.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:13 smithi040 bash[35794]: cluster 2024-02-10T08:33:12.149470+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:13.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:13 smithi040 bash[38951]: cluster 2024-02-10T08:33:12.149470+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:13.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:13 smithi145 bash[35820]: cluster 2024-02-10T08:33:12.149470+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:14.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:14 smithi040 bash[35794]: audit 2024-02-10T08:33:13.802455+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T08:33:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:14 smithi040 bash[35794]: audit 2024-02-10T08:33:13.803047+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:14 smithi040 bash[35794]: audit 2024-02-10T08:33:13.803717+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-10T08:33:14.484 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:14 smithi040 bash[38951]: audit 2024-02-10T08:33:13.802455+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T08:33:14.484 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:14 smithi040 bash[38951]: audit 2024-02-10T08:33:13.803047+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:14.484 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:14 smithi040 bash[38951]: audit 2024-02-10T08:33:13.803717+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-10T08:33:14.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:14 smithi145 bash[35820]: audit 2024-02-10T08:33:13.802455+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T08:33:14.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:14 smithi145 bash[35820]: audit 2024-02-10T08:33:13.803047+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:14.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:14 smithi145 bash[35820]: audit 2024-02-10T08:33:13.803717+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-10T08:33:15.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:15 smithi040 bash[35794]: cephadm 2024-02-10T08:33:13.803512+0000 mgr.y (mgr.14140) 54 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-10T08:33:15.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:15 smithi040 bash[35794]: cluster 2024-02-10T08:33:14.149745+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:15.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:15 smithi040 bash[38951]: cephadm 2024-02-10T08:33:13.803512+0000 mgr.y (mgr.14140) 54 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-10T08:33:15.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:15 smithi040 bash[38951]: cluster 2024-02-10T08:33:14.149745+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:15 smithi145 bash[35820]: cephadm 2024-02-10T08:33:13.803512+0000 mgr.y (mgr.14140) 54 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-10T08:33:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:15 smithi145 bash[35820]: cluster 2024-02-10T08:33:14.149745+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:15.599 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 0 on host 'smithi040' 2024-02-10T08:33:16.477 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:16 smithi040 bash[35794]: audit 2024-02-10T08:33:15.591317+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:16.478 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:16 smithi040 bash[38951]: audit 2024-02-10T08:33:15.591317+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:16.478 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:16 smithi040 bash[35794]: audit 2024-02-10T08:33:15.591712+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:16.478 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:16 smithi040 bash[35794]: audit 2024-02-10T08:33:15.597113+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:16.478 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:16 smithi040 bash[38951]: audit 2024-02-10T08:33:15.591712+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:16.478 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:16 smithi040 bash[38951]: audit 2024-02-10T08:33:15.597113+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:16 smithi145 bash[35820]: audit 2024-02-10T08:33:15.591317+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:16 smithi145 bash[35820]: audit 2024-02-10T08:33:15.591712+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:16 smithi145 bash[35820]: audit 2024-02-10T08:33:15.597113+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.572893\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573026\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:04.573114\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_device_update\": \"2024-02-10T08:31:49.271200\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:17.244 DEBUG:teuthology.orchestra.run.smithi040:osd.0> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.0.service 2024-02-10T08:33:17.246 INFO:tasks.cephadm:Deploying osd.1 on smithi040 with /dev/vg_nvme/lv_3... 2024-02-10T08:33:17.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-10T08:33:17.279 INFO:journalctl@ceph.osd.0.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:33:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:17 smithi145 bash[35820]: cluster 2024-02-10T08:33:16.150141+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:17 smithi040 bash[38951]: cluster 2024-02-10T08:33:16.150141+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:17.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:17 smithi040 bash[35794]: cluster 2024-02-10T08:33:16.150141+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:19 smithi145 bash[35820]: cluster 2024-02-10T08:33:18.150605+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:19.632 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:19 smithi040 bash[35794]: cluster 2024-02-10T08:33:18.150605+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:19.633 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:19 smithi040 bash[38951]: cluster 2024-02-10T08:33:18.150605+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:20.175 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 08:33:19 smithi040 bash[41300]: debug 2024-02-10T08:33:19.942+0000 7ff2bbfe4ec0 -1 Falling back to public interface 2024-02-10T08:33:20.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[35794]: audit 2024-02-10T08:33:19.542659+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:20.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[35794]: audit 2024-02-10T08:33:19.545915+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:20.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[35794]: audit 2024-02-10T08:33:19.546405+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:20.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[38951]: audit 2024-02-10T08:33:19.542659+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:20.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[38951]: audit 2024-02-10T08:33:19.545915+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:20.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[38951]: audit 2024-02-10T08:33:19.546405+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:20.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:20 smithi145 bash[35820]: audit 2024-02-10T08:33:19.542659+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:20.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:20 smithi145 bash[35820]: audit 2024-02-10T08:33:19.545915+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:20.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:20 smithi145 bash[35820]: audit 2024-02-10T08:33:19.546405+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:20.652 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-10T08:33:20.652 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-10T08:33:20.652 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-10T08:33:20.652 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-10T08:33:20.652 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111596 s, 940 MB/s 2024-02-10T08:33:20.652 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-10T08:33:20.925 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 08:33:20 smithi040 bash[41300]: debug 2024-02-10T08:33:20.498+0000 7ff2bbfe4ec0 -1 osd.0 0 log_to_monitors {default=true} 2024-02-10T08:33:21.234 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:21 smithi040 bash[38951]: cluster 2024-02-10T08:33:20.150935+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:21.234 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:21 smithi040 bash[38951]: audit 2024-02-10T08:33:20.502225+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:33:21.234 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:21 smithi040 bash[38951]: audit 2024-02-10T08:33:20.502485+0000 mon.a (mon.0) 191 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:33:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:21 smithi145 bash[35820]: cluster 2024-02-10T08:33:20.150935+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:21 smithi145 bash[35820]: audit 2024-02-10T08:33:20.502225+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:33:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:21 smithi145 bash[35820]: audit 2024-02-10T08:33:20.502485+0000 mon.a (mon.0) 191 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:33:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:21 smithi040 bash[35794]: cluster 2024-02-10T08:33:20.150935+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:21.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:21 smithi040 bash[35794]: audit 2024-02-10T08:33:20.502225+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:33:21.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:21 smithi040 bash[35794]: audit 2024-02-10T08:33:20.502485+0000 mon.a (mon.0) 191 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T08:33:21.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_3 2024-02-10T08:33:22.403 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[41300]: debug 2024-02-10T08:33:22.239+0000 7ff2a4d99700 -1 osd.0 0 waiting for initial osdmap 2024-02-10T08:33:22.403 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[41300]: debug 2024-02-10T08:33:22.245+0000 7ff2affb5700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: audit 2024-02-10T08:33:21.230430+0000 mon.a (mon.0) 192 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: cluster 2024-02-10T08:33:21.230478+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: audit 2024-02-10T08:33:21.230849+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: audit 2024-02-10T08:33:21.231545+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: audit 2024-02-10T08:33:21.235595+0000 mon.a (mon.0) 195 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: cluster 2024-02-10T08:33:21.482263+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: cluster 2024-02-10T08:33:21.482329+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:22.404 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[35794]: cluster 2024-02-10T08:33:22.151256+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: audit 2024-02-10T08:33:21.230430+0000 mon.a (mon.0) 192 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: cluster 2024-02-10T08:33:21.230478+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: audit 2024-02-10T08:33:21.230849+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: audit 2024-02-10T08:33:21.231545+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: audit 2024-02-10T08:33:21.235595+0000 mon.a (mon.0) 195 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: cluster 2024-02-10T08:33:21.482263+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: cluster 2024-02-10T08:33:21.482329+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:22.405 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:22 smithi040 bash[38951]: cluster 2024-02-10T08:33:22.151256+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: audit 2024-02-10T08:33:21.230430+0000 mon.a (mon.0) 192 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T08:33:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: cluster 2024-02-10T08:33:21.230478+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-10T08:33:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: audit 2024-02-10T08:33:21.230849+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: audit 2024-02-10T08:33:21.231545+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: audit 2024-02-10T08:33:21.235595+0000 mon.a (mon.0) 195 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: cluster 2024-02-10T08:33:21.482263+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: cluster 2024-02-10T08:33:21.482329+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:22 smithi145 bash[35820]: cluster 2024-02-10T08:33:22.151256+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:23 smithi145 bash[35820]: audit 2024-02-10T08:33:22.236628+0000 mon.a (mon.0) 196 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:33:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:23 smithi145 bash[35820]: cluster 2024-02-10T08:33:22.236681+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-10T08:33:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:23 smithi145 bash[35820]: audit 2024-02-10T08:33:22.237408+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:23.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:23 smithi040 bash[35794]: audit 2024-02-10T08:33:22.236628+0000 mon.a (mon.0) 196 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:33:23.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:23 smithi040 bash[35794]: cluster 2024-02-10T08:33:22.236681+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-10T08:33:23.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:23 smithi040 bash[35794]: audit 2024-02-10T08:33:22.237408+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:23.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:23 smithi040 bash[38951]: audit 2024-02-10T08:33:22.236628+0000 mon.a (mon.0) 196 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:33:23.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:23 smithi040 bash[38951]: cluster 2024-02-10T08:33:22.236681+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-10T08:33:23.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:23 smithi040 bash[38951]: audit 2024-02-10T08:33:22.237408+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[35794]: cluster 2024-02-10T08:33:23.251893+0000 mon.a (mon.0) 199 : cluster [INF] osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859] boot 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[35794]: cluster 2024-02-10T08:33:23.251939+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[35794]: audit 2024-02-10T08:33:23.252088+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[35794]: cluster 2024-02-10T08:33:24.151622+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[38951]: cluster 2024-02-10T08:33:23.251893+0000 mon.a (mon.0) 199 : cluster [INF] osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859] boot 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[38951]: cluster 2024-02-10T08:33:23.251939+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[38951]: audit 2024-02-10T08:33:23.252088+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:24.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:24 smithi040 bash[38951]: cluster 2024-02-10T08:33:24.151622+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:24.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:24 smithi145 bash[35820]: cluster 2024-02-10T08:33:23.251893+0000 mon.a (mon.0) 199 : cluster [INF] osd.0 [v2:172.21.15.40:6802/485086859,v1:172.21.15.40:6803/485086859] boot 2024-02-10T08:33:24.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:24 smithi145 bash[35820]: cluster 2024-02-10T08:33:23.251939+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-10T08:33:24.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:24 smithi145 bash[35820]: audit 2024-02-10T08:33:23.252088+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:33:24.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:24 smithi145 bash[35820]: cluster 2024-02-10T08:33:24.151622+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: cluster 2024-02-10T08:33:24.256739+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: audit 2024-02-10T08:33:24.886516+0000 mgr.y (mgr.14140) 61 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: cephadm 2024-02-10T08:33:24.887101+0000 mgr.y (mgr.14140) 62 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: audit 2024-02-10T08:33:24.887349+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: audit 2024-02-10T08:33:24.887889+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: audit 2024-02-10T08:33:24.888550+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:25.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[35794]: audit 2024-02-10T08:33:25.122115+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: cluster 2024-02-10T08:33:24.256739+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: audit 2024-02-10T08:33:24.886516+0000 mgr.y (mgr.14140) 61 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: cephadm 2024-02-10T08:33:24.887101+0000 mgr.y (mgr.14140) 62 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: audit 2024-02-10T08:33:24.887349+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: audit 2024-02-10T08:33:24.887889+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: audit 2024-02-10T08:33:24.888550+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:25.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:25 smithi040 bash[38951]: audit 2024-02-10T08:33:25.122115+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: cluster 2024-02-10T08:33:24.256739+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-10T08:33:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: audit 2024-02-10T08:33:24.886516+0000 mgr.y (mgr.14140) 61 : audit [DBG] from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: cephadm 2024-02-10T08:33:24.887101+0000 mgr.y (mgr.14140) 62 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: audit 2024-02-10T08:33:24.887349+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: audit 2024-02-10T08:33:24.887889+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: audit 2024-02-10T08:33:24.888550+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:25 smithi145 bash[35820]: audit 2024-02-10T08:33:25.122115+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:26.345 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[35794]: cluster 2024-02-10T08:33:25.266709+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-10T08:33:26.345 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[38951]: cluster 2024-02-10T08:33:25.266709+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-10T08:33:26.346 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[35794]: audit 2024-02-10T08:33:25.340895+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:26.346 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[35794]: audit 2024-02-10T08:33:25.343617+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:26.346 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[35794]: cluster 2024-02-10T08:33:26.151974+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:26.346 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[38951]: audit 2024-02-10T08:33:25.340895+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:26.346 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[38951]: audit 2024-02-10T08:33:25.343617+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:26.346 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:26 smithi040 bash[38951]: cluster 2024-02-10T08:33:26.151974+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:26.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:26 smithi145 bash[35820]: cluster 2024-02-10T08:33:25.266709+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-10T08:33:26.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:26 smithi145 bash[35820]: audit 2024-02-10T08:33:25.340895+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:26.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:26 smithi145 bash[35820]: audit 2024-02-10T08:33:25.343617+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}}, \"last_daemon_update\": \"2024-02-10T08:33:19.542028\", \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:26.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:26 smithi145 bash[35820]: cluster 2024-02-10T08:33:26.151974+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:27 smithi145 bash[35820]: cluster 2024-02-10T08:33:27.074094+0000 mon.a (mon.0) 210 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:33:27.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:27 smithi040 bash[35794]: cluster 2024-02-10T08:33:27.074094+0000 mon.a (mon.0) 210 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:33:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:27 smithi040 bash[38951]: cluster 2024-02-10T08:33:27.074094+0000 mon.a (mon.0) 210 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:33:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: audit 2024-02-10T08:33:27.296689+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.40:0/290867547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]: dispatch 2024-02-10T08:33:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: audit 2024-02-10T08:33:27.296943+0000 mon.a (mon.0) 211 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]: dispatch 2024-02-10T08:33:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: audit 2024-02-10T08:33:27.300109+0000 mon.a (mon.0) 212 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]': finished 2024-02-10T08:33:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: cluster 2024-02-10T08:33:27.300156+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-10T08:33:28.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: audit 2024-02-10T08:33:27.300270+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:28.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: audit 2024-02-10T08:33:28.045370+0000 mon.a (mon.0) 215 : audit [DBG] from='client.? 172.21.15.40:0/4053577849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:28.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:28 smithi145 bash[35820]: cluster 2024-02-10T08:33:28.152252+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v55: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: audit 2024-02-10T08:33:27.296689+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.40:0/290867547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]: dispatch 2024-02-10T08:33:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: audit 2024-02-10T08:33:27.296943+0000 mon.a (mon.0) 211 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]: dispatch 2024-02-10T08:33:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: audit 2024-02-10T08:33:27.300109+0000 mon.a (mon.0) 212 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]': finished 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: cluster 2024-02-10T08:33:27.300156+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: audit 2024-02-10T08:33:27.300270+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: audit 2024-02-10T08:33:28.045370+0000 mon.a (mon.0) 215 : audit [DBG] from='client.? 172.21.15.40:0/4053577849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[35794]: cluster 2024-02-10T08:33:28.152252+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v55: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: audit 2024-02-10T08:33:27.296689+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.40:0/290867547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]: dispatch 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: audit 2024-02-10T08:33:27.296943+0000 mon.a (mon.0) 211 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]: dispatch 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: audit 2024-02-10T08:33:27.300109+0000 mon.a (mon.0) 212 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09f46a8e-6338-4458-a3d6-28560e580b5a"}]': finished 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: cluster 2024-02-10T08:33:27.300156+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: audit 2024-02-10T08:33:27.300270+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: audit 2024-02-10T08:33:28.045370+0000 mon.a (mon.0) 215 : audit [DBG] from='client.? 172.21.15.40:0/4053577849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:28 smithi040 bash[38951]: cluster 2024-02-10T08:33:28.152252+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v55: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:31.382 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:31 smithi040 bash[35794]: cluster 2024-02-10T08:33:30.152679+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:31.383 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:31 smithi040 bash[35794]: audit 2024-02-10T08:33:30.647032+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:31.383 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:31 smithi040 bash[38951]: cluster 2024-02-10T08:33:30.152679+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:31.383 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:31 smithi040 bash[38951]: audit 2024-02-10T08:33:30.647032+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:31.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:31 smithi145 bash[35820]: cluster 2024-02-10T08:33:30.152679+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:31.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:31 smithi145 bash[35820]: audit 2024-02-10T08:33:30.647032+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:33 smithi145 bash[35820]: cluster 2024-02-10T08:33:32.153158+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:33.565 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:33 smithi040 bash[35794]: cluster 2024-02-10T08:33:32.153158+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:33.565 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:33 smithi040 bash[38951]: cluster 2024-02-10T08:33:32.153158+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:34 smithi040 bash[35794]: audit 2024-02-10T08:33:33.577603+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T08:33:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:34 smithi040 bash[35794]: audit 2024-02-10T08:33:33.578296+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:34 smithi040 bash[35794]: audit 2024-02-10T08:33:33.579015+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-10T08:33:34.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:34 smithi040 bash[38951]: audit 2024-02-10T08:33:33.577603+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T08:33:34.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:34 smithi040 bash[38951]: audit 2024-02-10T08:33:33.578296+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:34.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:34 smithi040 bash[38951]: audit 2024-02-10T08:33:33.579015+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-10T08:33:34.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:34 smithi145 bash[35820]: audit 2024-02-10T08:33:33.577603+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T08:33:34.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:34 smithi145 bash[35820]: audit 2024-02-10T08:33:33.578296+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:34.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:34 smithi145 bash[35820]: audit 2024-02-10T08:33:33.579015+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-10T08:33:35.268 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:35 smithi040 bash[35794]: cephadm 2024-02-10T08:33:33.578788+0000 mgr.y (mgr.14140) 67 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-10T08:33:35.269 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:35 smithi040 bash[35794]: cluster 2024-02-10T08:33:34.153566+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:35.269 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:35 smithi040 bash[38951]: cephadm 2024-02-10T08:33:33.578788+0000 mgr.y (mgr.14140) 67 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-10T08:33:35.269 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:35 smithi040 bash[38951]: cluster 2024-02-10T08:33:34.153566+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:35.341 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 1 on host 'smithi040' 2024-02-10T08:33:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:35 smithi145 bash[35820]: cephadm 2024-02-10T08:33:33.578788+0000 mgr.y (mgr.14140) 67 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-10T08:33:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:35 smithi145 bash[35820]: cluster 2024-02-10T08:33:34.153566+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:36.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[35794]: audit 2024-02-10T08:33:35.334591+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:36.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[35794]: audit 2024-02-10T08:33:35.334997+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:36.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[35794]: audit 2024-02-10T08:33:35.338143+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:36.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[35794]: cluster 2024-02-10T08:33:36.074320+0000 mon.a (mon.0) 223 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-10T08:33:36.302 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[38951]: audit 2024-02-10T08:33:35.334591+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:36.302 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[38951]: audit 2024-02-10T08:33:35.334997+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:36.302 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[38951]: audit 2024-02-10T08:33:35.338143+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:36.302 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[38951]: cluster 2024-02-10T08:33:36.074320+0000 mon.a (mon.0) 223 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-10T08:33:36.315 DEBUG:teuthology.orchestra.run.smithi040:osd.1> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.1.service 2024-02-10T08:33:36.361 INFO:tasks.cephadm:Deploying osd.2 on smithi040 with /dev/vg_nvme/lv_2... 2024-02-10T08:33:36.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-10T08:33:36.396 INFO:journalctl@ceph.osd.1.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:33:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:36 smithi145 bash[35820]: audit 2024-02-10T08:33:35.334591+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:36 smithi145 bash[35820]: audit 2024-02-10T08:33:35.334997+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:36 smithi145 bash[35820]: audit 2024-02-10T08:33:35.338143+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541811\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541889\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541924\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:19.541954\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_device_update\": \"2024-02-10T08:33:25.340273\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:36 smithi145 bash[35820]: cluster 2024-02-10T08:33:36.074320+0000 mon.a (mon.0) 223 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-10T08:33:36.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:36 smithi040 bash[42555]: --> ceph-volume lvm activate successful for osd ID: 1 2024-02-10T08:33:37.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:37 smithi040 bash[38951]: cluster 2024-02-10T08:33:36.154093+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:37 smithi040 bash[35794]: cluster 2024-02-10T08:33:36.154093+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:37 smithi145 bash[35820]: cluster 2024-02-10T08:33:36.154093+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:39.364 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:39 smithi040 bash[35794]: cluster 2024-02-10T08:33:38.154472+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:39.365 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:39 smithi040 bash[38951]: cluster 2024-02-10T08:33:38.154472+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:39.365 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:39 smithi040 bash[42783]: debug 2024-02-10T08:33:39.106+0000 7f7c45f0cec0 -1 Falling back to public interface 2024-02-10T08:33:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:39 smithi145 bash[35820]: cluster 2024-02-10T08:33:38.154472+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:39.925 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:39 smithi040 bash[42783]: debug 2024-02-10T08:33:39.666+0000 7f7c45f0cec0 -1 osd.1 0 log_to_monitors {default=true} 2024-02-10T08:33:40.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:40 smithi040 bash[35794]: audit 2024-02-10T08:33:39.671212+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:33:40.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:40 smithi040 bash[35794]: audit 2024-02-10T08:33:39.671535+0000 mon.a (mon.0) 224 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:33:40.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:40 smithi040 bash[38951]: audit 2024-02-10T08:33:39.671212+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:33:40.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:40 smithi040 bash[38951]: audit 2024-02-10T08:33:39.671535+0000 mon.a (mon.0) 224 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:33:40.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:40 smithi145 bash[35820]: audit 2024-02-10T08:33:39.671212+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:33:40.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:40 smithi145 bash[35820]: audit 2024-02-10T08:33:39.671535+0000 mon.a (mon.0) 224 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T08:33:40.578 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-10T08:33:40.578 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-10T08:33:40.579 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-10T08:33:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-10T08:33:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125213 s, 837 MB/s 2024-02-10T08:33:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-10T08:33:41.515 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[42783]: debug 2024-02-10T08:33:41.241+0000 7f7c2acb9700 -1 osd.1 0 waiting for initial osdmap 2024-02-10T08:33:41.516 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[42783]: debug 2024-02-10T08:33:41.244+0000 7f7c35ed5700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-10T08:33:41.516 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: cluster 2024-02-10T08:33:40.154835+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:41.516 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.236199+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T08:33:41.516 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: cluster 2024-02-10T08:33:40.236245+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-10T08:33:41.516 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.236657+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:41.516 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.237084+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.237376+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.354889+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.358232+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: audit 2024-02-10T08:33:40.358860+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: cluster 2024-02-10T08:33:40.650274+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[35794]: cluster 2024-02-10T08:33:40.650318+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: cluster 2024-02-10T08:33:40.154835+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.236199+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: cluster 2024-02-10T08:33:40.236245+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.236657+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.237084+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.237376+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:41.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.354889+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:41.518 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.358232+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:41.518 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: audit 2024-02-10T08:33:40.358860+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:41.518 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: cluster 2024-02-10T08:33:40.650274+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:41.518 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:41 smithi040 bash[38951]: cluster 2024-02-10T08:33:40.650318+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:41.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_2 2024-02-10T08:33:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: cluster 2024-02-10T08:33:40.154835+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.236199+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: cluster 2024-02-10T08:33:40.236245+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.236657+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.237084+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.237376+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.354889+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.358232+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: audit 2024-02-10T08:33:40.358860+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: cluster 2024-02-10T08:33:40.650274+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:33:41.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:41 smithi145 bash[35820]: cluster 2024-02-10T08:33:40.650318+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:33:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:42 smithi145 bash[35820]: audit 2024-02-10T08:33:41.236907+0000 mon.a (mon.0) 232 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:33:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:42 smithi145 bash[35820]: cluster 2024-02-10T08:33:41.236954+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-10T08:33:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:42 smithi145 bash[35820]: audit 2024-02-10T08:33:41.237432+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:42 smithi145 bash[35820]: cluster 2024-02-10T08:33:42.155225+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[35794]: audit 2024-02-10T08:33:41.236907+0000 mon.a (mon.0) 232 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[35794]: cluster 2024-02-10T08:33:41.236954+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[35794]: audit 2024-02-10T08:33:41.237432+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[35794]: cluster 2024-02-10T08:33:42.155225+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[38951]: audit 2024-02-10T08:33:41.236907+0000 mon.a (mon.0) 232 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[38951]: cluster 2024-02-10T08:33:41.236954+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[38951]: audit 2024-02-10T08:33:41.237432+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:42.565 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:42 smithi040 bash[38951]: cluster 2024-02-10T08:33:42.155225+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-10T08:33:43.531 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:43 smithi040 bash[35794]: cluster 2024-02-10T08:33:42.244612+0000 mon.a (mon.0) 235 : cluster [INF] osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490] boot 2024-02-10T08:33:43.531 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:43 smithi040 bash[35794]: cluster 2024-02-10T08:33:42.244654+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-10T08:33:43.531 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:43 smithi040 bash[35794]: audit 2024-02-10T08:33:42.245184+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:43.531 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:43 smithi040 bash[38951]: cluster 2024-02-10T08:33:42.244612+0000 mon.a (mon.0) 235 : cluster [INF] osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490] boot 2024-02-10T08:33:43.532 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:43 smithi040 bash[38951]: cluster 2024-02-10T08:33:42.244654+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-10T08:33:43.532 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:43 smithi040 bash[38951]: audit 2024-02-10T08:33:42.245184+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:43 smithi145 bash[35820]: cluster 2024-02-10T08:33:42.244612+0000 mon.a (mon.0) 235 : cluster [INF] osd.1 [v2:172.21.15.40:6810/2032348490,v1:172.21.15.40:6811/2032348490] boot 2024-02-10T08:33:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:43 smithi145 bash[35820]: cluster 2024-02-10T08:33:42.244654+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-10T08:33:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:43 smithi145 bash[35820]: audit 2024-02-10T08:33:42.245184+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:33:44.460 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[35794]: cluster 2024-02-10T08:33:43.251266+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-10T08:33:44.460 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[35794]: audit 2024-02-10T08:33:43.393770+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240210-083140"}]: dispatch 2024-02-10T08:33:44.460 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[35794]: audit 2024-02-10T08:33:43.397028+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240210-083140"}]': finished 2024-02-10T08:33:44.460 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[35794]: cluster 2024-02-10T08:33:44.155486+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:44.461 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[38951]: cluster 2024-02-10T08:33:43.251266+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-10T08:33:44.461 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[38951]: audit 2024-02-10T08:33:43.393770+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240210-083140"}]: dispatch 2024-02-10T08:33:44.461 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[38951]: audit 2024-02-10T08:33:43.397028+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240210-083140"}]': finished 2024-02-10T08:33:44.461 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:44 smithi040 bash[38951]: cluster 2024-02-10T08:33:44.155486+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:44 smithi145 bash[35820]: cluster 2024-02-10T08:33:43.251266+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-10T08:33:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:44 smithi145 bash[35820]: audit 2024-02-10T08:33:43.393770+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240210-083140"}]: dispatch 2024-02-10T08:33:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:44 smithi145 bash[35820]: audit 2024-02-10T08:33:43.397028+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240210-083140"}]': finished 2024-02-10T08:33:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:44 smithi145 bash[35820]: cluster 2024-02-10T08:33:44.155486+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:45.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[35794]: audit 2024-02-10T08:33:44.983085+0000 mgr.y (mgr.14140) 74 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:45.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[35794]: cephadm 2024-02-10T08:33:44.983677+0000 mgr.y (mgr.14140) 75 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:45.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[35794]: audit 2024-02-10T08:33:44.983928+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[35794]: audit 2024-02-10T08:33:44.984493+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[35794]: audit 2024-02-10T08:33:44.985206+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[35794]: audit 2024-02-10T08:33:45.354473+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[38951]: audit 2024-02-10T08:33:44.983085+0000 mgr.y (mgr.14140) 74 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[38951]: cephadm 2024-02-10T08:33:44.983677+0000 mgr.y (mgr.14140) 75 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[38951]: audit 2024-02-10T08:33:44.983928+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[38951]: audit 2024-02-10T08:33:44.984493+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[38951]: audit 2024-02-10T08:33:44.985206+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:45.649 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:45 smithi040 bash[38951]: audit 2024-02-10T08:33:45.354473+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:45 smithi145 bash[35820]: audit 2024-02-10T08:33:44.983085+0000 mgr.y (mgr.14140) 74 : audit [DBG] from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:33:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:45 smithi145 bash[35820]: cephadm 2024-02-10T08:33:44.983677+0000 mgr.y (mgr.14140) 75 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:33:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:45 smithi145 bash[35820]: audit 2024-02-10T08:33:44.983928+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:33:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:45 smithi145 bash[35820]: audit 2024-02-10T08:33:44.984493+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:45 smithi145 bash[35820]: audit 2024-02-10T08:33:44.985206+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:45 smithi145 bash[35820]: audit 2024-02-10T08:33:45.354473+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:46.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:46 smithi040 bash[35794]: audit 2024-02-10T08:33:45.569084+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:46.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:46 smithi040 bash[35794]: audit 2024-02-10T08:33:45.571841+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:46.536 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:46 smithi040 bash[35794]: cluster 2024-02-10T08:33:46.155765+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:46.536 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:46 smithi040 bash[38951]: audit 2024-02-10T08:33:45.569084+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:46.537 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:46 smithi040 bash[38951]: audit 2024-02-10T08:33:45.571841+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:46.537 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:46 smithi040 bash[38951]: cluster 2024-02-10T08:33:46.155765+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:46.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:46 smithi145 bash[35820]: audit 2024-02-10T08:33:45.569084+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:46.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:46 smithi145 bash[35820]: audit 2024-02-10T08:33:45.571841+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}}, \"last_daemon_update\": \"2024-02-10T08:33:40.354181\", \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:46.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:46 smithi145 bash[35820]: cluster 2024-02-10T08:33:46.155765+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[35794]: audit 2024-02-10T08:33:47.500828+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.40:0/2403149561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]: dispatch 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[35794]: audit 2024-02-10T08:33:47.501117+0000 mon.a (mon.0) 247 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]: dispatch 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[35794]: audit 2024-02-10T08:33:47.504646+0000 mon.a (mon.0) 248 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]': finished 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[35794]: cluster 2024-02-10T08:33:47.504675+0000 mon.a (mon.0) 249 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[35794]: audit 2024-02-10T08:33:47.504794+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[38951]: audit 2024-02-10T08:33:47.500828+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.40:0/2403149561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]: dispatch 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[38951]: audit 2024-02-10T08:33:47.501117+0000 mon.a (mon.0) 247 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]: dispatch 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[38951]: audit 2024-02-10T08:33:47.504646+0000 mon.a (mon.0) 248 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]': finished 2024-02-10T08:33:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[38951]: cluster 2024-02-10T08:33:47.504675+0000 mon.a (mon.0) 249 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-10T08:33:48.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:48 smithi040 bash[38951]: audit 2024-02-10T08:33:47.504794+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:33:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:48 smithi145 bash[35820]: audit 2024-02-10T08:33:47.500828+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.15.40:0/2403149561' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]: dispatch 2024-02-10T08:33:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:48 smithi145 bash[35820]: audit 2024-02-10T08:33:47.501117+0000 mon.a (mon.0) 247 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]: dispatch 2024-02-10T08:33:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:48 smithi145 bash[35820]: audit 2024-02-10T08:33:47.504646+0000 mon.a (mon.0) 248 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5397c1c-cc08-4591-9a75-867299f80a86"}]': finished 2024-02-10T08:33:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:48 smithi145 bash[35820]: cluster 2024-02-10T08:33:47.504675+0000 mon.a (mon.0) 249 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-10T08:33:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:48 smithi145 bash[35820]: audit 2024-02-10T08:33:47.504794+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:33:49.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:49 smithi040 bash[38951]: cluster 2024-02-10T08:33:48.156080+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:49.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:49 smithi040 bash[38951]: audit 2024-02-10T08:33:48.266831+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.40:0/563958569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:49 smithi040 bash[35794]: cluster 2024-02-10T08:33:48.156080+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:49.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:49 smithi040 bash[35794]: audit 2024-02-10T08:33:48.266831+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.40:0/563958569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:49 smithi145 bash[35820]: cluster 2024-02-10T08:33:48.156080+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v70: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-10T08:33:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:49 smithi145 bash[35820]: audit 2024-02-10T08:33:48.266831+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.40:0/563958569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:33:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:50 smithi145 bash[35820]: cluster 2024-02-10T08:33:50.156424+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:50 smithi145 bash[35820]: cluster 2024-02-10T08:33:50.207173+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:33:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:50 smithi145 bash[35820]: cluster 2024-02-10T08:33:50.207246+0000 mon.a (mon.0) 252 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-10T08:33:50.561 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:50 smithi040 bash[35794]: cluster 2024-02-10T08:33:50.156424+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:50.561 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:50 smithi040 bash[35794]: cluster 2024-02-10T08:33:50.207173+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:33:50.562 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:50 smithi040 bash[35794]: cluster 2024-02-10T08:33:50.207246+0000 mon.a (mon.0) 252 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-10T08:33:50.562 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:50 smithi040 bash[38951]: cluster 2024-02-10T08:33:50.156424+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:50.562 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:50 smithi040 bash[38951]: cluster 2024-02-10T08:33:50.207173+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-10T08:33:50.562 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:50 smithi040 bash[38951]: cluster 2024-02-10T08:33:50.207246+0000 mon.a (mon.0) 252 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-10T08:33:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:51 smithi145 bash[35820]: audit 2024-02-10T08:33:50.847878+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:51 smithi040 bash[35794]: audit 2024-02-10T08:33:50.847878+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:51.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:51 smithi040 bash[38951]: audit 2024-02-10T08:33:50.847878+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:33:52.490 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:52 smithi040 bash[35794]: cluster 2024-02-10T08:33:52.156766+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:52.490 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:52 smithi040 bash[38951]: cluster 2024-02-10T08:33:52.156766+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:52.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:52 smithi145 bash[35820]: cluster 2024-02-10T08:33:52.156766+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:53.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:53 smithi040 bash[35794]: audit 2024-02-10T08:33:53.618039+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T08:33:53.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:53 smithi040 bash[35794]: audit 2024-02-10T08:33:53.618722+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:53.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:53 smithi040 bash[35794]: audit 2024-02-10T08:33:53.619460+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-10T08:33:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:53 smithi040 bash[38951]: audit 2024-02-10T08:33:53.618039+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T08:33:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:53 smithi040 bash[38951]: audit 2024-02-10T08:33:53.618722+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:53 smithi040 bash[38951]: audit 2024-02-10T08:33:53.619460+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-10T08:33:54.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:53 smithi145 bash[35820]: audit 2024-02-10T08:33:53.618039+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T08:33:54.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:53 smithi145 bash[35820]: audit 2024-02-10T08:33:53.618722+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:33:54.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:53 smithi145 bash[35820]: audit 2024-02-10T08:33:53.619460+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-10T08:33:55.005 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:54 smithi040 bash[35794]: cephadm 2024-02-10T08:33:53.619215+0000 mgr.y (mgr.14140) 80 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-10T08:33:55.005 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:54 smithi040 bash[35794]: cluster 2024-02-10T08:33:54.157258+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:55.005 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:54 smithi040 bash[38951]: cephadm 2024-02-10T08:33:53.619215+0000 mgr.y (mgr.14140) 80 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-10T08:33:55.005 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:54 smithi040 bash[38951]: cluster 2024-02-10T08:33:54.157258+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:55.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:54 smithi145 bash[35820]: cephadm 2024-02-10T08:33:53.619215+0000 mgr.y (mgr.14140) 80 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-10T08:33:55.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:54 smithi145 bash[35820]: cluster 2024-02-10T08:33:54.157258+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:55.537 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 2 on host 'smithi040' 2024-02-10T08:33:56.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:55 smithi145 bash[35820]: audit 2024-02-10T08:33:55.528203+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:55 smithi145 bash[35820]: audit 2024-02-10T08:33:55.529048+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:55 smithi145 bash[35820]: audit 2024-02-10T08:33:55.531717+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:56.067 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:55 smithi040 bash[35794]: audit 2024-02-10T08:33:55.528203+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:56.067 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:55 smithi040 bash[35794]: audit 2024-02-10T08:33:55.529048+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:56.067 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:55 smithi040 bash[35794]: audit 2024-02-10T08:33:55.531717+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:56.067 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:55 smithi040 bash[38951]: audit 2024-02-10T08:33:55.528203+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:33:56.067 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:55 smithi040 bash[38951]: audit 2024-02-10T08:33:55.529048+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:33:56.067 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:55 smithi040 bash[38951]: audit 2024-02-10T08:33:55.531717+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.353933\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354006\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354040\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354076\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:40.354106\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_device_update\": \"2024-02-10T08:33:45.568446\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:33:57.143 DEBUG:teuthology.orchestra.run.smithi040:osd.2> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.2.service 2024-02-10T08:33:57.145 INFO:tasks.cephadm:Deploying osd.3 on smithi040 with /dev/vg_nvme/lv_1... 2024-02-10T08:33:57.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-10T08:33:57.177 INFO:journalctl@ceph.osd.2.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:33:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:57 smithi040 bash[35794]: cluster 2024-02-10T08:33:56.157542+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:57 smithi040 bash[38951]: cluster 2024-02-10T08:33:56.157542+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:57 smithi145 bash[35820]: cluster 2024-02-10T08:33:56.157542+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:59.517 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:33:59 smithi040 bash[35794]: cluster 2024-02-10T08:33:58.157863+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:59.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:33:59 smithi040 bash[38951]: cluster 2024-02-10T08:33:58.157863+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:33:59 smithi145 bash[35820]: cluster 2024-02-10T08:33:58.157863+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 10+0 records in 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:10+0 records out 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107796 s, 973 MB/s 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr: stderr: 2024-02-10T08:33:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:--> Zapping successful for: 2024-02-10T08:34:00.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:00 smithi145 bash[35820]: audit 2024-02-10T08:33:59.793125+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:00.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:00 smithi145 bash[35820]: audit 2024-02-10T08:33:59.798847+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:00.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:00 smithi145 bash[35820]: audit 2024-02-10T08:33:59.799418+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:00.574 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:00 smithi040 bash[35794]: audit 2024-02-10T08:33:59.793125+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:00.574 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:00 smithi040 bash[35794]: audit 2024-02-10T08:33:59.798847+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:00.574 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:00 smithi040 bash[35794]: audit 2024-02-10T08:33:59.799418+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:00.575 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:00 smithi040 bash[38951]: audit 2024-02-10T08:33:59.793125+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:00.575 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:00 smithi040 bash[38951]: audit 2024-02-10T08:33:59.798847+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:00.575 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:00 smithi040 bash[38951]: audit 2024-02-10T08:33:59.799418+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:01 smithi145 bash[35820]: cluster 2024-02-10T08:34:00.158240+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:01 smithi040 bash[35794]: cluster 2024-02-10T08:34:00.158240+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:01 smithi040 bash[38951]: cluster 2024-02-10T08:34:00.158240+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:01.676 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 08:34:01 smithi040 bash[44604]: debug 2024-02-10T08:34:01.222+0000 7f45a23cbec0 -1 Falling back to public interface 2024-02-10T08:34:01.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi040:vg_nvme/lv_1 2024-02-10T08:34:02.048 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 08:34:01 smithi040 bash[44604]: debug 2024-02-10T08:34:01.774+0000 7f45a23cbec0 -1 osd.2 0 log_to_monitors {default=true} 2024-02-10T08:34:02.396 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:02 smithi040 bash[38951]: audit 2024-02-10T08:34:01.778788+0000 mon.a (mon.0) 263 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:34:02.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:02 smithi040 bash[35794]: audit 2024-02-10T08:34:01.778788+0000 mon.a (mon.0) 263 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:34:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:02 smithi145 bash[35820]: audit 2024-02-10T08:34:01.778788+0000 mon.a (mon.0) 263 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T08:34:03.491 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[44604]: debug 2024-02-10T08:34:03.231+0000 7f4587178700 -1 osd.2 0 waiting for initial osdmap 2024-02-10T08:34:03.491 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[44604]: debug 2024-02-10T08:34:03.236+0000 7f4592394700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-10T08:34:03.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: cluster 2024-02-10T08:34:02.158622+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:03.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: audit 2024-02-10T08:34:02.226510+0000 mon.a (mon.0) 264 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T08:34:03.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: cluster 2024-02-10T08:34:02.226543+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-10T08:34:03.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: audit 2024-02-10T08:34:02.226652+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:03.491 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: audit 2024-02-10T08:34:02.226955+0000 mon.a (mon.0) 267 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: cluster 2024-02-10T08:34:02.774166+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[35794]: cluster 2024-02-10T08:34:02.774205+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: cluster 2024-02-10T08:34:02.158622+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: audit 2024-02-10T08:34:02.226510+0000 mon.a (mon.0) 264 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: cluster 2024-02-10T08:34:02.226543+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: audit 2024-02-10T08:34:02.226652+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: audit 2024-02-10T08:34:02.226955+0000 mon.a (mon.0) 267 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: cluster 2024-02-10T08:34:02.774166+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:03.492 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:03 smithi040 bash[38951]: cluster 2024-02-10T08:34:02.774205+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: cluster 2024-02-10T08:34:02.158622+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: audit 2024-02-10T08:34:02.226510+0000 mon.a (mon.0) 264 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: cluster 2024-02-10T08:34:02.226543+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: audit 2024-02-10T08:34:02.226652+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: audit 2024-02-10T08:34:02.226955+0000 mon.a (mon.0) 267 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: cluster 2024-02-10T08:34:02.774166+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:03 smithi145 bash[35820]: cluster 2024-02-10T08:34:02.774205+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:04.373 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:04 smithi040 bash[35794]: audit 2024-02-10T08:34:03.228258+0000 mon.a (mon.0) 268 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:34:04.373 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:04 smithi040 bash[35794]: cluster 2024-02-10T08:34:03.228299+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-10T08:34:04.373 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:04 smithi040 bash[35794]: audit 2024-02-10T08:34:03.228808+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:04.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:04 smithi040 bash[38951]: audit 2024-02-10T08:34:03.228258+0000 mon.a (mon.0) 268 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:34:04.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:04 smithi040 bash[38951]: cluster 2024-02-10T08:34:03.228299+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-10T08:34:04.373 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:04 smithi040 bash[38951]: audit 2024-02-10T08:34:03.228808+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:04.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:04 smithi145 bash[35820]: audit 2024-02-10T08:34:03.228258+0000 mon.a (mon.0) 268 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:34:04.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:04 smithi145 bash[35820]: cluster 2024-02-10T08:34:03.228299+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-10T08:34:04.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:04 smithi145 bash[35820]: audit 2024-02-10T08:34:03.228808+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:05.340 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: cluster 2024-02-10T08:34:04.158927+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:05.340 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: cluster 2024-02-10T08:34:04.239423+0000 mon.a (mon.0) 271 : cluster [INF] osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414] boot 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: cluster 2024-02-10T08:34:04.239503+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: audit 2024-02-10T08:34:04.239981+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: audit 2024-02-10T08:34:04.801613+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: audit 2024-02-10T08:34:04.802130+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[35794]: audit 2024-02-10T08:34:04.802835+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: cluster 2024-02-10T08:34:04.158927+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: cluster 2024-02-10T08:34:04.239423+0000 mon.a (mon.0) 271 : cluster [INF] osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414] boot 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: cluster 2024-02-10T08:34:04.239503+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: audit 2024-02-10T08:34:04.239981+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: audit 2024-02-10T08:34:04.801613+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: audit 2024-02-10T08:34:04.802130+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:05.341 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:05 smithi040 bash[38951]: audit 2024-02-10T08:34:04.802835+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:05.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: cluster 2024-02-10T08:34:04.158927+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:05.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: cluster 2024-02-10T08:34:04.239423+0000 mon.a (mon.0) 271 : cluster [INF] osd.2 [v2:172.21.15.40:6818/42000414,v1:172.21.15.40:6819/42000414] boot 2024-02-10T08:34:05.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: cluster 2024-02-10T08:34:04.239503+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-10T08:34:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: audit 2024-02-10T08:34:04.239981+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:34:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: audit 2024-02-10T08:34:04.801613+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: audit 2024-02-10T08:34:04.802130+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:05 smithi145 bash[35820]: audit 2024-02-10T08:34:04.802835+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: audit 2024-02-10T08:34:04.800817+0000 mgr.y (mgr.14140) 87 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:06.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: cephadm 2024-02-10T08:34:04.801386+0000 mgr.y (mgr.14140) 88 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:34:06.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: cluster 2024-02-10T08:34:05.239312+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-10T08:34:06.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: audit 2024-02-10T08:34:05.709538+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:06.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: audit 2024-02-10T08:34:05.924949+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:06.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: audit 2024-02-10T08:34:05.927560+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:06.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:06 smithi145 bash[35820]: cluster 2024-02-10T08:34:06.159289+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:06.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: audit 2024-02-10T08:34:04.800817+0000 mgr.y (mgr.14140) 87 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:06.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: cephadm 2024-02-10T08:34:04.801386+0000 mgr.y (mgr.14140) 88 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:34:06.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: cluster 2024-02-10T08:34:05.239312+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-10T08:34:06.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: audit 2024-02-10T08:34:05.709538+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:06.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: audit 2024-02-10T08:34:05.924949+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:06.579 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: audit 2024-02-10T08:34:04.800817+0000 mgr.y (mgr.14140) 87 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:06.579 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: cephadm 2024-02-10T08:34:04.801386+0000 mgr.y (mgr.14140) 88 : cephadm [INF] Applying osd on host smithi040... 2024-02-10T08:34:06.580 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: cluster 2024-02-10T08:34:05.239312+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-10T08:34:06.580 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: audit 2024-02-10T08:34:05.709538+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:06.580 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: audit 2024-02-10T08:34:05.927560+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:06.580 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[38951]: cluster 2024-02-10T08:34:06.159289+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:06.580 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: audit 2024-02-10T08:34:05.924949+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:06.581 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: audit 2024-02-10T08:34:05.927560+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}}, \"last_daemon_update\": \"2024-02-10T08:33:59.792447\", \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:06.581 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:06 smithi040 bash[35794]: cluster 2024-02-10T08:34:06.159289+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[35794]: audit 2024-02-10T08:34:07.569518+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.40:0/3099370034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]: dispatch 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[35794]: audit 2024-02-10T08:34:07.569831+0000 mon.a (mon.0) 281 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]: dispatch 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[35794]: audit 2024-02-10T08:34:07.573535+0000 mon.a (mon.0) 282 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]': finished 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[35794]: cluster 2024-02-10T08:34:07.573577+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[35794]: audit 2024-02-10T08:34:07.573666+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[38951]: audit 2024-02-10T08:34:07.569518+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.40:0/3099370034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]: dispatch 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[38951]: audit 2024-02-10T08:34:07.569831+0000 mon.a (mon.0) 281 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]: dispatch 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[38951]: audit 2024-02-10T08:34:07.573535+0000 mon.a (mon.0) 282 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]': finished 2024-02-10T08:34:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[38951]: cluster 2024-02-10T08:34:07.573577+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-10T08:34:08.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:08 smithi040 bash[38951]: audit 2024-02-10T08:34:07.573666+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:08 smithi145 bash[35820]: audit 2024-02-10T08:34:07.569518+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.40:0/3099370034' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]: dispatch 2024-02-10T08:34:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:08 smithi145 bash[35820]: audit 2024-02-10T08:34:07.569831+0000 mon.a (mon.0) 281 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]: dispatch 2024-02-10T08:34:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:08 smithi145 bash[35820]: audit 2024-02-10T08:34:07.573535+0000 mon.a (mon.0) 282 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98f5c8b5-a97a-4e49-a7eb-46639f974dde"}]': finished 2024-02-10T08:34:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:08 smithi145 bash[35820]: cluster 2024-02-10T08:34:07.573577+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-10T08:34:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:08 smithi145 bash[35820]: audit 2024-02-10T08:34:07.573666+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:09 smithi040 bash[35794]: cluster 2024-02-10T08:34:08.159610+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:09 smithi040 bash[35794]: audit 2024-02-10T08:34:08.393691+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.40:0/4243712884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:09 smithi040 bash[38951]: cluster 2024-02-10T08:34:08.159610+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:09 smithi040 bash[38951]: audit 2024-02-10T08:34:08.393691+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.40:0/4243712884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:09 smithi145 bash[35820]: cluster 2024-02-10T08:34:08.159610+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-10T08:34:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:09 smithi145 bash[35820]: audit 2024-02-10T08:34:08.393691+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.40:0/4243712884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:10.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:10 smithi145 bash[35820]: cluster 2024-02-10T08:34:10.160104+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:10.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:10 smithi145 bash[35820]: cluster 2024-02-10T08:34:10.210874+0000 mon.a (mon.0) 285 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-10T08:34:10.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:10 smithi145 bash[35820]: cluster 2024-02-10T08:34:10.210948+0000 mon.a (mon.0) 286 : cluster [INF] Cluster is now healthy 2024-02-10T08:34:10.614 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:10 smithi040 bash[35794]: cluster 2024-02-10T08:34:10.160104+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:10.614 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:10 smithi040 bash[35794]: cluster 2024-02-10T08:34:10.210874+0000 mon.a (mon.0) 285 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-10T08:34:10.614 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:10 smithi040 bash[35794]: cluster 2024-02-10T08:34:10.210948+0000 mon.a (mon.0) 286 : cluster [INF] Cluster is now healthy 2024-02-10T08:34:10.614 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:10 smithi040 bash[38951]: cluster 2024-02-10T08:34:10.160104+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:10.614 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:10 smithi040 bash[38951]: cluster 2024-02-10T08:34:10.210874+0000 mon.a (mon.0) 285 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-10T08:34:10.614 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:10 smithi040 bash[38951]: cluster 2024-02-10T08:34:10.210948+0000 mon.a (mon.0) 286 : cluster [INF] Cluster is now healthy 2024-02-10T08:34:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:11 smithi145 bash[35820]: audit 2024-02-10T08:34:10.950509+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:11.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:11 smithi040 bash[35794]: audit 2024-02-10T08:34:10.950509+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:11 smithi040 bash[38951]: audit 2024-02-10T08:34:10.950509+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:12.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:12 smithi040 bash[35794]: cluster 2024-02-10T08:34:12.160566+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:12 smithi040 bash[38951]: cluster 2024-02-10T08:34:12.160566+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:12.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:12 smithi145 bash[35820]: cluster 2024-02-10T08:34:12.160566+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:14.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:14 smithi040 bash[38951]: audit 2024-02-10T08:34:14.011301+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T08:34:14.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:14 smithi040 bash[38951]: audit 2024-02-10T08:34:14.012002+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:14.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:14 smithi040 bash[38951]: audit 2024-02-10T08:34:14.012732+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-10T08:34:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:14 smithi040 bash[35794]: audit 2024-02-10T08:34:14.011301+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T08:34:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:14 smithi040 bash[35794]: audit 2024-02-10T08:34:14.012002+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:14.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:14 smithi040 bash[35794]: audit 2024-02-10T08:34:14.012732+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-10T08:34:14.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:14 smithi145 bash[35820]: audit 2024-02-10T08:34:14.011301+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T08:34:14.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:14 smithi145 bash[35820]: audit 2024-02-10T08:34:14.012002+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:14.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:14 smithi145 bash[35820]: audit 2024-02-10T08:34:14.012732+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-10T08:34:15.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:15 smithi040 bash[35794]: cephadm 2024-02-10T08:34:14.012497+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-10T08:34:15.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:15 smithi040 bash[35794]: cluster 2024-02-10T08:34:14.160906+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:15.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:15 smithi040 bash[38951]: cephadm 2024-02-10T08:34:14.012497+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-10T08:34:15.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:15 smithi040 bash[38951]: cluster 2024-02-10T08:34:14.160906+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:15 smithi145 bash[35820]: cephadm 2024-02-10T08:34:14.012497+0000 mgr.y (mgr.14140) 93 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-10T08:34:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:15 smithi145 bash[35820]: cluster 2024-02-10T08:34:14.160906+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:15.893 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 3 on host 'smithi040' 2024-02-10T08:34:16.074 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:16 smithi040 bash[38951]: audit 2024-02-10T08:34:15.883952+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:16.075 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:16 smithi040 bash[38951]: audit 2024-02-10T08:34:15.884459+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:16.075 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:16 smithi040 bash[38951]: audit 2024-02-10T08:34:15.887774+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:16 smithi040 bash[35794]: audit 2024-02-10T08:34:15.883952+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:16 smithi040 bash[35794]: audit 2024-02-10T08:34:15.884459+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:16 smithi040 bash[35794]: audit 2024-02-10T08:34:15.887774+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:16 smithi145 bash[35820]: audit 2024-02-10T08:34:15.883952+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:16 smithi145 bash[35820]: audit 2024-02-10T08:34:15.884459+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:16 smithi145 bash[35820]: audit 2024-02-10T08:34:15.887774+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792196\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792270\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792303\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792332\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792361\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:33:59.792388\", \"created\": \"2024-02-10T08:33:55.493219\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_device_update\": \"2024-02-10T08:34:05.924262\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:17.243 DEBUG:teuthology.orchestra.run.smithi040:osd.3> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.3.service 2024-02-10T08:34:17.245 INFO:tasks.cephadm:Deploying osd.4 on smithi145 with /dev/vg_nvme/lv_4... 2024-02-10T08:34:17.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-10T08:34:17.274 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[35794]: cluster 2024-02-10T08:34:16.161215+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:17.275 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[38951]: cluster 2024-02-10T08:34:16.161215+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:17.278 INFO:journalctl@ceph.osd.3.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:34:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:17 smithi145 bash[35820]: cluster 2024-02-10T08:34:16.161215+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-10T08:34:18.365 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:17 smithi040 bash[45719]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-10T08:34:19.361 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-10T08:34:19.362 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-10T08:34:19.362 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-02-10T08:34:19.362 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-02-10T08:34:19.362 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109965 s, 954 MB/s 2024-02-10T08:34:19.362 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-02-10T08:34:19.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:19 smithi040 bash[35794]: cluster 2024-02-10T08:34:18.161578+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:19.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:19 smithi040 bash[38951]: cluster 2024-02-10T08:34:18.161578+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:19 smithi145 bash[35820]: cluster 2024-02-10T08:34:18.161578+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:19.952 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:19 smithi040 bash[46018]: debug 2024-02-10T08:34:19.700+0000 7f7c1b55cec0 -1 Falling back to public interface 2024-02-10T08:34:20.131 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi145:vg_nvme/lv_4 2024-02-10T08:34:20.484 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:20 smithi145 bash[35820]: audit 2024-02-10T08:34:19.456413+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:20.484 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:20 smithi145 bash[35820]: audit 2024-02-10T08:34:19.459921+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:20.484 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:20 smithi145 bash[35820]: audit 2024-02-10T08:34:19.460433+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:20.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[46018]: debug 2024-02-10T08:34:20.252+0000 7f7c1b55cec0 -1 osd.3 0 log_to_monitors {default=true} 2024-02-10T08:34:20.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[35794]: audit 2024-02-10T08:34:19.456413+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:20.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[38951]: audit 2024-02-10T08:34:19.456413+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:20.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[35794]: audit 2024-02-10T08:34:19.459921+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:20.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[35794]: audit 2024-02-10T08:34:19.460433+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:20.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[38951]: audit 2024-02-10T08:34:19.459921+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:20.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:20 smithi040 bash[38951]: audit 2024-02-10T08:34:19.460433+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:21.398 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:21 smithi040 bash[38951]: cluster 2024-02-10T08:34:20.161944+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:21.399 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:21 smithi040 bash[38951]: audit 2024-02-10T08:34:20.256035+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:34:21.399 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:21 smithi040 bash[38951]: audit 2024-02-10T08:34:20.256347+0000 mon.a (mon.0) 297 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:34:21.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:21 smithi040 bash[35794]: cluster 2024-02-10T08:34:20.161944+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:21.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:21 smithi040 bash[35794]: audit 2024-02-10T08:34:20.256035+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:34:21.399 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:21 smithi040 bash[35794]: audit 2024-02-10T08:34:20.256347+0000 mon.a (mon.0) 297 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:34:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:21 smithi145 bash[35820]: cluster 2024-02-10T08:34:20.161944+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:21 smithi145 bash[35820]: audit 2024-02-10T08:34:20.256035+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:34:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:21 smithi145 bash[35820]: audit 2024-02-10T08:34:20.256347+0000 mon.a (mon.0) 297 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T08:34:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: audit 2024-02-10T08:34:21.222858+0000 mon.a (mon.0) 298 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T08:34:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: cluster 2024-02-10T08:34:21.222905+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-10T08:34:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: audit 2024-02-10T08:34:21.223415+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: audit 2024-02-10T08:34:21.223545+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: audit 2024-02-10T08:34:21.223928+0000 mon.a (mon.0) 301 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: cluster 2024-02-10T08:34:21.245566+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: cluster 2024-02-10T08:34:21.245612+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: audit 2024-02-10T08:34:22.222634+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:34:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: cluster 2024-02-10T08:34:22.222685+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-10T08:34:22.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:22 smithi145 bash[35820]: audit 2024-02-10T08:34:22.222809+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:22.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[46018]: debug 2024-02-10T08:34:22.224+0000 7f7c00309700 -1 osd.3 0 waiting for initial osdmap 2024-02-10T08:34:22.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[46018]: debug 2024-02-10T08:34:22.228+0000 7f7c0b525700 -1 osd.3 25 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-10T08:34:22.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: audit 2024-02-10T08:34:21.222858+0000 mon.a (mon.0) 298 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: cluster 2024-02-10T08:34:21.222905+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: audit 2024-02-10T08:34:21.223415+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: audit 2024-02-10T08:34:21.223545+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: audit 2024-02-10T08:34:21.223928+0000 mon.a (mon.0) 301 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: cluster 2024-02-10T08:34:21.245566+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: cluster 2024-02-10T08:34:21.245612+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: audit 2024-02-10T08:34:22.222634+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: cluster 2024-02-10T08:34:22.222685+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[35794]: audit 2024-02-10T08:34:22.222809+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: audit 2024-02-10T08:34:21.222858+0000 mon.a (mon.0) 298 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: cluster 2024-02-10T08:34:21.222905+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-10T08:34:22.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: audit 2024-02-10T08:34:21.223415+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: audit 2024-02-10T08:34:21.223545+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: audit 2024-02-10T08:34:21.223928+0000 mon.a (mon.0) 301 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: cluster 2024-02-10T08:34:21.245566+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: cluster 2024-02-10T08:34:21.245612+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: audit 2024-02-10T08:34:22.222634+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: cluster 2024-02-10T08:34:22.222685+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-10T08:34:22.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:22 smithi040 bash[38951]: audit 2024-02-10T08:34:22.222809+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:23.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[38951]: cluster 2024-02-10T08:34:22.162236+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[38951]: audit 2024-02-10T08:34:22.284171+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[38951]: audit 2024-02-10T08:34:22.284815+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[38951]: audit 2024-02-10T08:34:22.285687+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[38951]: audit 2024-02-10T08:34:23.019338+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[35794]: cluster 2024-02-10T08:34:22.162236+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[35794]: audit 2024-02-10T08:34:22.284171+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[35794]: audit 2024-02-10T08:34:22.284815+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[35794]: audit 2024-02-10T08:34:22.285687+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:23 smithi040 bash[35794]: audit 2024-02-10T08:34:23.019338+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:23 smithi145 bash[35820]: cluster 2024-02-10T08:34:22.162236+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-10T08:34:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:23 smithi145 bash[35820]: audit 2024-02-10T08:34:22.284171+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:23 smithi145 bash[35820]: audit 2024-02-10T08:34:22.284815+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:23 smithi145 bash[35820]: audit 2024-02-10T08:34:22.285687+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:23.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:23 smithi145 bash[35820]: audit 2024-02-10T08:34:23.019338+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: audit 2024-02-10T08:34:22.283156+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: cephadm 2024-02-10T08:34:22.283886+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: cluster 2024-02-10T08:34:23.236584+0000 mon.a (mon.0) 309 : cluster [INF] osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638] boot 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: cluster 2024-02-10T08:34:23.236622+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: audit 2024-02-10T08:34:23.237072+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: audit 2024-02-10T08:34:23.240989+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:24 smithi145 bash[35820]: audit 2024-02-10T08:34:23.243097+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: audit 2024-02-10T08:34:22.283156+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: cephadm 2024-02-10T08:34:22.283886+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: cluster 2024-02-10T08:34:23.236584+0000 mon.a (mon.0) 309 : cluster [INF] osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638] boot 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: cluster 2024-02-10T08:34:23.236622+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: audit 2024-02-10T08:34:23.237072+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: audit 2024-02-10T08:34:22.283156+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: cephadm 2024-02-10T08:34:22.283886+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: cluster 2024-02-10T08:34:23.236584+0000 mon.a (mon.0) 309 : cluster [INF] osd.3 [v2:172.21.15.40:6826/1379176638,v1:172.21.15.40:6827/1379176638] boot 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: cluster 2024-02-10T08:34:23.236622+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: audit 2024-02-10T08:34:23.237072+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: audit 2024-02-10T08:34:23.240989+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[35794]: audit 2024-02-10T08:34:23.243097+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: audit 2024-02-10T08:34:23.240989+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:34:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:24 smithi040 bash[38951]: audit 2024-02-10T08:34:23.243097+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}}, \"last_daemon_update\": \"2024-02-10T08:34:19.455742\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:34:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: cluster 2024-02-10T08:34:24.162496+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 265 GiB / 268 GiB avail 2024-02-10T08:34:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: cluster 2024-02-10T08:34:24.249281+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-10T08:34:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: audit 2024-02-10T08:34:24.580962+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.145:0/1718538780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]: dispatch 2024-02-10T08:34:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: audit 2024-02-10T08:34:24.581563+0000 mon.a (mon.0) 315 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]: dispatch 2024-02-10T08:34:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: audit 2024-02-10T08:34:24.585730+0000 mon.a (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]': finished 2024-02-10T08:34:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: cluster 2024-02-10T08:34:24.585796+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-10T08:34:25.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:25 smithi145 bash[35820]: audit 2024-02-10T08:34:24.585934+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: cluster 2024-02-10T08:34:24.162496+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 265 GiB / 268 GiB avail 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: cluster 2024-02-10T08:34:24.249281+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: audit 2024-02-10T08:34:24.580962+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.145:0/1718538780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]: dispatch 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: audit 2024-02-10T08:34:24.581563+0000 mon.a (mon.0) 315 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]: dispatch 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: audit 2024-02-10T08:34:24.585730+0000 mon.a (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]': finished 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: cluster 2024-02-10T08:34:24.585796+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[35794]: audit 2024-02-10T08:34:24.585934+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: cluster 2024-02-10T08:34:24.162496+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 265 GiB / 268 GiB avail 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: cluster 2024-02-10T08:34:24.249281+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: audit 2024-02-10T08:34:24.580962+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.145:0/1718538780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]: dispatch 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: audit 2024-02-10T08:34:24.581563+0000 mon.a (mon.0) 315 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]: dispatch 2024-02-10T08:34:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: audit 2024-02-10T08:34:24.585730+0000 mon.a (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1eac730-f5c7-46ec-a931-196ac88f2df0"}]': finished 2024-02-10T08:34:25.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: cluster 2024-02-10T08:34:24.585796+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-10T08:34:25.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:25 smithi040 bash[38951]: audit 2024-02-10T08:34:24.585934+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:26.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:26 smithi145 bash[35820]: audit 2024-02-10T08:34:25.321546+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.145:0/1610514661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:26.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:26 smithi145 bash[35820]: cluster 2024-02-10T08:34:26.163020+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:26.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:26 smithi040 bash[35794]: audit 2024-02-10T08:34:25.321546+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.145:0/1610514661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:26.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:26 smithi040 bash[35794]: cluster 2024-02-10T08:34:26.163020+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:26.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:26 smithi040 bash[38951]: audit 2024-02-10T08:34:25.321546+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.145:0/1610514661' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:26.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:26 smithi040 bash[38951]: cluster 2024-02-10T08:34:26.163020+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:28 smithi145 bash[35820]: audit 2024-02-10T08:34:27.916168+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:28 smithi040 bash[35794]: audit 2024-02-10T08:34:27.916168+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:28.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:28 smithi040 bash[38951]: audit 2024-02-10T08:34:27.916168+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:29 smithi145 bash[35820]: cluster 2024-02-10T08:34:28.163530+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:29 smithi040 bash[35794]: cluster 2024-02-10T08:34:28.163530+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:29 smithi040 bash[38951]: cluster 2024-02-10T08:34:28.163530+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:31 smithi145 bash[35820]: cluster 2024-02-10T08:34:30.164094+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:31 smithi145 bash[35820]: audit 2024-02-10T08:34:30.617939+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T08:34:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:31 smithi145 bash[35820]: audit 2024-02-10T08:34:30.618715+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:31 smithi145 bash[35820]: audit 2024-02-10T08:34:30.619615+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-10T08:34:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[35794]: cluster 2024-02-10T08:34:30.164094+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[35794]: audit 2024-02-10T08:34:30.617939+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[35794]: audit 2024-02-10T08:34:30.618715+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[35794]: audit 2024-02-10T08:34:30.619615+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[38951]: cluster 2024-02-10T08:34:30.164094+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[38951]: audit 2024-02-10T08:34:30.617939+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[38951]: audit 2024-02-10T08:34:30.618715+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:31 smithi040 bash[38951]: audit 2024-02-10T08:34:30.619615+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-10T08:34:32.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:32 smithi145 bash[35820]: cephadm 2024-02-10T08:34:30.619350+0000 mgr.y (mgr.14140) 105 : cephadm [INF] Deploying daemon osd.4 on smithi145 2024-02-10T08:34:32.286 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 4 on host 'smithi145' 2024-02-10T08:34:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:32 smithi040 bash[35794]: cephadm 2024-02-10T08:34:30.619350+0000 mgr.y (mgr.14140) 105 : cephadm [INF] Deploying daemon osd.4 on smithi145 2024-02-10T08:34:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:32 smithi040 bash[38951]: cephadm 2024-02-10T08:34:30.619350+0000 mgr.y (mgr.14140) 105 : cephadm [INF] Deploying daemon osd.4 on smithi145 2024-02-10T08:34:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:33 smithi145 bash[35820]: cluster 2024-02-10T08:34:32.164411+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:33 smithi145 bash[35820]: audit 2024-02-10T08:34:32.280690+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:33 smithi145 bash[35820]: audit 2024-02-10T08:34:32.281111+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:33 smithi145 bash[35820]: audit 2024-02-10T08:34:32.283769+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[35794]: cluster 2024-02-10T08:34:32.164411+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[35794]: audit 2024-02-10T08:34:32.280690+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[35794]: audit 2024-02-10T08:34:32.281111+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[35794]: audit 2024-02-10T08:34:32.283769+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[38951]: cluster 2024-02-10T08:34:32.164411+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[38951]: audit 2024-02-10T08:34:32.280690+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[38951]: audit 2024-02-10T08:34:32.281111+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:33 smithi040 bash[38951]: audit 2024-02-10T08:34:32.283769+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952851\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:32:59.952929\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_device_update\": \"2024-02-10T08:32:17.124520\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:34.253 DEBUG:teuthology.orchestra.run.smithi145:osd.4> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.4.service 2024-02-10T08:34:34.255 INFO:tasks.cephadm:Deploying osd.5 on smithi145 with /dev/vg_nvme/lv_3... 2024-02-10T08:34:34.256 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-10T08:34:34.287 INFO:journalctl@ceph.osd.4.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:34:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:35 smithi145 bash[35820]: cluster 2024-02-10T08:34:34.164849+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:35 smithi145 bash[35820]: audit 2024-02-10T08:34:35.150236+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:35.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:35 smithi145 bash[35820]: audit 2024-02-10T08:34:35.153459+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:35.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:35 smithi145 bash[35820]: audit 2024-02-10T08:34:35.154201+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[35794]: cluster 2024-02-10T08:34:34.164849+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[38951]: cluster 2024-02-10T08:34:34.164849+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[38951]: audit 2024-02-10T08:34:35.150236+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[38951]: audit 2024-02-10T08:34:35.153459+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[38951]: audit 2024-02-10T08:34:35.154201+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[35794]: audit 2024-02-10T08:34:35.150236+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[35794]: audit 2024-02-10T08:34:35.153459+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:35 smithi040 bash[35794]: audit 2024-02-10T08:34:35.154201+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:36.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 08:34:35 smithi145 bash[38246]: debug 2024-02-10T08:34:35.563+0000 7fad5ad0bec0 -1 Falling back to public interface 2024-02-10T08:34:36.518 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 08:34:36 smithi145 bash[38246]: debug 2024-02-10T08:34:36.112+0000 7fad5ad0bec0 -1 osd.4 0 log_to_monitors {default=true} 2024-02-10T08:34:37.349 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:37 smithi145 bash[35820]: audit 2024-02-10T08:34:36.116229+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:34:37.349 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:37 smithi145 bash[35820]: audit 2024-02-10T08:34:36.116609+0000 mon.a (mon.0) 329 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:34:37.349 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:37 smithi145 bash[35820]: cluster 2024-02-10T08:34:36.165257+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:37.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:37 smithi040 bash[35794]: audit 2024-02-10T08:34:36.116229+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:34:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:37 smithi040 bash[35794]: audit 2024-02-10T08:34:36.116609+0000 mon.a (mon.0) 329 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:34:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:37 smithi040 bash[35794]: cluster 2024-02-10T08:34:36.165257+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:37 smithi040 bash[38951]: audit 2024-02-10T08:34:36.116229+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:34:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:37 smithi040 bash[38951]: audit 2024-02-10T08:34:36.116609+0000 mon.a (mon.0) 329 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T08:34:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:37 smithi040 bash[38951]: cluster 2024-02-10T08:34:36.165257+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:38.282 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[38246]: debug 2024-02-10T08:34:38.098+0000 7fad43ac0700 -1 osd.4 0 waiting for initial osdmap 2024-02-10T08:34:38.282 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[38246]: debug 2024-02-10T08:34:38.104+0000 7fad4ecdc700 -1 osd.4 30 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-10T08:34:38.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[35820]: audit 2024-02-10T08:34:37.095331+0000 mon.a (mon.0) 330 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:34:38.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[35820]: cluster 2024-02-10T08:34:37.095366+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-10T08:34:38.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[35820]: audit 2024-02-10T08:34:37.095523+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:38.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[35820]: audit 2024-02-10T08:34:37.095872+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:38.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:38 smithi145 bash[35820]: audit 2024-02-10T08:34:37.096226+0000 mon.a (mon.0) 333 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:38.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[35794]: audit 2024-02-10T08:34:37.095331+0000 mon.a (mon.0) 330 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:34:38.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[35794]: cluster 2024-02-10T08:34:37.095366+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[35794]: audit 2024-02-10T08:34:37.095523+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[35794]: audit 2024-02-10T08:34:37.095872+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[35794]: audit 2024-02-10T08:34:37.096226+0000 mon.a (mon.0) 333 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[38951]: audit 2024-02-10T08:34:37.095331+0000 mon.a (mon.0) 330 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[38951]: cluster 2024-02-10T08:34:37.095366+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[38951]: audit 2024-02-10T08:34:37.095523+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[38951]: audit 2024-02-10T08:34:37.095872+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:38.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:38 smithi040 bash[38951]: audit 2024-02-10T08:34:37.096226+0000 mon.a (mon.0) 333 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:38.673 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-10T08:34:38.673 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-10T08:34:38.674 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-02-10T08:34:38.674 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-02-10T08:34:38.674 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123201 s, 851 MB/s 2024-02-10T08:34:38.674 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-02-10T08:34:39.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: cluster 2024-02-10T08:34:37.139575+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: cluster 2024-02-10T08:34:37.139633+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: audit 2024-02-10T08:34:38.097170+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: cluster 2024-02-10T08:34:38.097238+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: audit 2024-02-10T08:34:38.098104+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: cluster 2024-02-10T08:34:38.165570+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: audit 2024-02-10T08:34:39.090014+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: cluster 2024-02-10T08:34:39.098153+0000 mon.a (mon.0) 338 : cluster [INF] osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815] boot 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: cluster 2024-02-10T08:34:39.098210+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[35794]: audit 2024-02-10T08:34:39.098396+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: cluster 2024-02-10T08:34:37.139575+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:39.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: cluster 2024-02-10T08:34:37.139633+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: audit 2024-02-10T08:34:38.097170+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: cluster 2024-02-10T08:34:38.097238+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: audit 2024-02-10T08:34:38.098104+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: cluster 2024-02-10T08:34:38.165570+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: audit 2024-02-10T08:34:39.090014+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: cluster 2024-02-10T08:34:39.098153+0000 mon.a (mon.0) 338 : cluster [INF] osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815] boot 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: cluster 2024-02-10T08:34:39.098210+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-10T08:34:39.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:39 smithi040 bash[38951]: audit 2024-02-10T08:34:39.098396+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: cluster 2024-02-10T08:34:37.139575+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: cluster 2024-02-10T08:34:37.139633+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: audit 2024-02-10T08:34:38.097170+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: cluster 2024-02-10T08:34:38.097238+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: audit 2024-02-10T08:34:38.098104+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: cluster 2024-02-10T08:34:38.165570+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: audit 2024-02-10T08:34:39.090014+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: cluster 2024-02-10T08:34:39.098153+0000 mon.a (mon.0) 338 : cluster [INF] osd.4 [v2:172.21.15.145:6800/4251252815,v1:172.21.15.145:6801/4251252815] boot 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: cluster 2024-02-10T08:34:39.098210+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-10T08:34:39.444 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:39 smithi145 bash[35820]: audit 2024-02-10T08:34:39.098396+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:34:39.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi145:vg_nvme/lv_3 2024-02-10T08:34:40.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:40 smithi145 bash[35820]: audit 2024-02-10T08:34:39.274633+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:40.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:40 smithi145 bash[35820]: audit 2024-02-10T08:34:39.277789+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:40.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:40 smithi145 bash[35820]: cluster 2024-02-10T08:34:40.106571+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-10T08:34:40.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:40 smithi040 bash[35794]: audit 2024-02-10T08:34:39.274633+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:40.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:40 smithi040 bash[35794]: audit 2024-02-10T08:34:39.277789+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:40.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:40 smithi040 bash[35794]: cluster 2024-02-10T08:34:40.106571+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-10T08:34:40.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:40 smithi040 bash[38951]: audit 2024-02-10T08:34:39.274633+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:40.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:40 smithi040 bash[38951]: audit 2024-02-10T08:34:39.277789+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}}, \"last_daemon_update\": \"2024-02-10T08:34:35.149618\", \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:40.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:40 smithi040 bash[38951]: cluster 2024-02-10T08:34:40.106571+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-10T08:34:41.372 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:41 smithi145 bash[35820]: cluster 2024-02-10T08:34:40.165997+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1012 KiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:41.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:41 smithi040 bash[35794]: cluster 2024-02-10T08:34:40.165997+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1012 KiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:41.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:41 smithi040 bash[38951]: cluster 2024-02-10T08:34:40.165997+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 1012 KiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:42.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:42 smithi040 bash[38951]: audit 2024-02-10T08:34:41.786370+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:42.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:42 smithi040 bash[38951]: audit 2024-02-10T08:34:41.787241+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:42 smithi040 bash[38951]: audit 2024-02-10T08:34:41.788455+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:42 smithi040 bash[35794]: audit 2024-02-10T08:34:41.786370+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:42 smithi040 bash[35794]: audit 2024-02-10T08:34:41.787241+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:42 smithi040 bash[35794]: audit 2024-02-10T08:34:41.788455+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:42.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:42 smithi145 bash[35820]: audit 2024-02-10T08:34:41.786370+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:34:42.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:42 smithi145 bash[35820]: audit 2024-02-10T08:34:41.787241+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:42.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:42 smithi145 bash[35820]: audit 2024-02-10T08:34:41.788455+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:43.397 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:43 smithi145 bash[35820]: audit 2024-02-10T08:34:41.785278+0000 mgr.y (mgr.14140) 111 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:43.397 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:43 smithi145 bash[35820]: cephadm 2024-02-10T08:34:41.786055+0000 mgr.y (mgr.14140) 112 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:34:43.398 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:43 smithi145 bash[35820]: cluster 2024-02-10T08:34:42.166520+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 1.0 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:43.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:43 smithi040 bash[38951]: audit 2024-02-10T08:34:41.785278+0000 mgr.y (mgr.14140) 111 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:43.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:43 smithi040 bash[38951]: cephadm 2024-02-10T08:34:41.786055+0000 mgr.y (mgr.14140) 112 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:34:43.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:43 smithi040 bash[38951]: cluster 2024-02-10T08:34:42.166520+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 1.0 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:43 smithi040 bash[35794]: audit 2024-02-10T08:34:41.785278+0000 mgr.y (mgr.14140) 111 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:34:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:43 smithi040 bash[35794]: cephadm 2024-02-10T08:34:41.786055+0000 mgr.y (mgr.14140) 112 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:34:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:43 smithi040 bash[35794]: cluster 2024-02-10T08:34:42.166520+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 1.0 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:44.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[35794]: audit 2024-02-10T08:34:44.069364+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.145:0/2503884360' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]: dispatch 2024-02-10T08:34:44.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[35794]: audit 2024-02-10T08:34:44.069774+0000 mon.a (mon.0) 347 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]: dispatch 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[35794]: audit 2024-02-10T08:34:44.074619+0000 mon.a (mon.0) 348 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]': finished 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[35794]: cluster 2024-02-10T08:34:44.074677+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[35794]: audit 2024-02-10T08:34:44.074828+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[38951]: audit 2024-02-10T08:34:44.069364+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.145:0/2503884360' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]: dispatch 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[38951]: audit 2024-02-10T08:34:44.069774+0000 mon.a (mon.0) 347 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]: dispatch 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[38951]: audit 2024-02-10T08:34:44.074619+0000 mon.a (mon.0) 348 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]': finished 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[38951]: cluster 2024-02-10T08:34:44.074677+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-10T08:34:44.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:44 smithi040 bash[38951]: audit 2024-02-10T08:34:44.074828+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:34:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:44 smithi145 bash[35820]: audit 2024-02-10T08:34:44.069364+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.145:0/2503884360' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]: dispatch 2024-02-10T08:34:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:44 smithi145 bash[35820]: audit 2024-02-10T08:34:44.069774+0000 mon.a (mon.0) 347 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]: dispatch 2024-02-10T08:34:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:44 smithi145 bash[35820]: audit 2024-02-10T08:34:44.074619+0000 mon.a (mon.0) 348 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65bd977b-afd2-4a17-b201-37abf5a7dba9"}]': finished 2024-02-10T08:34:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:44 smithi145 bash[35820]: cluster 2024-02-10T08:34:44.074677+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-10T08:34:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:44 smithi145 bash[35820]: audit 2024-02-10T08:34:44.074828+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:34:45.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:45 smithi040 bash[35794]: cluster 2024-02-10T08:34:44.166956+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:45.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:45 smithi040 bash[35794]: audit 2024-02-10T08:34:44.850394+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.145:0/2785133758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:45.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:45 smithi040 bash[38951]: cluster 2024-02-10T08:34:44.166956+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:45.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:45 smithi040 bash[38951]: audit 2024-02-10T08:34:44.850394+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.145:0/2785133758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:45.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:45 smithi145 bash[35820]: cluster 2024-02-10T08:34:44.166956+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:45.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:45 smithi145 bash[35820]: audit 2024-02-10T08:34:44.850394+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.145:0/2785133758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:34:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:47 smithi040 bash[35794]: cluster 2024-02-10T08:34:46.167400+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:47 smithi040 bash[38951]: cluster 2024-02-10T08:34:46.167400+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:47 smithi145 bash[35820]: cluster 2024-02-10T08:34:46.167400+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:48.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:48 smithi040 bash[35794]: audit 2024-02-10T08:34:47.694318+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:48 smithi040 bash[38951]: audit 2024-02-10T08:34:47.694318+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:48 smithi145 bash[35820]: audit 2024-02-10T08:34:47.694318+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:49.329 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:49 smithi145 bash[35820]: cluster 2024-02-10T08:34:48.167811+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:49.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:49 smithi040 bash[35794]: cluster 2024-02-10T08:34:48.167811+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:49.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:49 smithi040 bash[38951]: cluster 2024-02-10T08:34:48.167811+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:51.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:51 smithi145 bash[35820]: cluster 2024-02-10T08:34:50.168301+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:51.512 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:51 smithi145 bash[35820]: audit 2024-02-10T08:34:50.405575+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T08:34:51.512 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:51 smithi145 bash[35820]: audit 2024-02-10T08:34:50.406367+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:51.512 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:51 smithi145 bash[35820]: audit 2024-02-10T08:34:50.407247+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[35794]: cluster 2024-02-10T08:34:50.168301+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[35794]: audit 2024-02-10T08:34:50.405575+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[35794]: audit 2024-02-10T08:34:50.406367+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[35794]: audit 2024-02-10T08:34:50.407247+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[38951]: cluster 2024-02-10T08:34:50.168301+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[38951]: audit 2024-02-10T08:34:50.405575+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[38951]: audit 2024-02-10T08:34:50.406367+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:34:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:51 smithi040 bash[38951]: audit 2024-02-10T08:34:50.407247+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-10T08:34:52.159 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 5 on host 'smithi145' 2024-02-10T08:34:52.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:52 smithi145 bash[35820]: cephadm 2024-02-10T08:34:50.406956+0000 mgr.y (mgr.14140) 118 : cephadm [INF] Deploying daemon osd.5 on smithi145 2024-02-10T08:34:52.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:52 smithi145 bash[35820]: audit 2024-02-10T08:34:52.150900+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:52.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:52 smithi145 bash[35820]: audit 2024-02-10T08:34:52.151344+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:52.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:52 smithi145 bash[35820]: audit 2024-02-10T08:34:52.155040+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[35794]: cephadm 2024-02-10T08:34:50.406956+0000 mgr.y (mgr.14140) 118 : cephadm [INF] Deploying daemon osd.5 on smithi145 2024-02-10T08:34:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[38951]: cephadm 2024-02-10T08:34:50.406956+0000 mgr.y (mgr.14140) 118 : cephadm [INF] Deploying daemon osd.5 on smithi145 2024-02-10T08:34:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[35794]: audit 2024-02-10T08:34:52.150900+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[35794]: audit 2024-02-10T08:34:52.151344+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[35794]: audit 2024-02-10T08:34:52.155040+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:52.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[38951]: audit 2024-02-10T08:34:52.150900+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:52.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[38951]: audit 2024-02-10T08:34:52.151344+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:34:52.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:52 smithi040 bash[38951]: audit 2024-02-10T08:34:52.155040+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149386\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149481\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:35.149520\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_device_update\": \"2024-02-10T08:34:39.274009\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:53.237 DEBUG:teuthology.orchestra.run.smithi145:osd.5> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.5.service 2024-02-10T08:34:53.239 INFO:tasks.cephadm:Deploying osd.6 on smithi145 with /dev/vg_nvme/lv_2... 2024-02-10T08:34:53.239 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-10T08:34:53.270 INFO:journalctl@ceph.osd.5.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:34:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[35820]: cluster 2024-02-10T08:34:52.168595+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:53 smithi040 bash[35794]: cluster 2024-02-10T08:34:52.168595+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:53.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:53 smithi040 bash[38951]: cluster 2024-02-10T08:34:52.168595+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-10T08:34:53.994 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-10T08:34:53.994 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-10T08:34:53.994 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-02-10T08:34:53.994 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-10T08:34:53.995 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-10T08:34:53.995 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-10T08:34:53.995 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:53 smithi145 bash[39530]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-10T08:34:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:55 smithi145 bash[35820]: cluster 2024-02-10T08:34:54.169042+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:55 smithi145 bash[35820]: audit 2024-02-10T08:34:55.180453+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:34:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:55 smithi145 bash[35820]: audit 2024-02-10T08:34:55.183880+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:34:55.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:55 smithi040 bash[38951]: cluster 2024-02-10T08:34:54.169042+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:55 smithi040 bash[38951]: audit 2024-02-10T08:34:55.180453+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:34:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:55 smithi040 bash[38951]: audit 2024-02-10T08:34:55.183880+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:34:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:55 smithi040 bash[35794]: cluster 2024-02-10T08:34:54.169042+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:55 smithi040 bash[35794]: audit 2024-02-10T08:34:55.180453+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:34:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:55 smithi040 bash[35794]: audit 2024-02-10T08:34:55.183880+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:34:56.525 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-10T08:34:56.525 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-10T08:34:56.525 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-02-10T08:34:56.526 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-02-10T08:34:56.526 INFO:teuthology.orchestra.run.smithi145.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111117 s, 944 MB/s 2024-02-10T08:34:56.526 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-02-10T08:34:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:56 smithi145 bash[35820]: audit 2024-02-10T08:34:56.046842+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:56 smithi145 bash[35820]: audit 2024-02-10T08:34:56.049888+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:56 smithi145 bash[35820]: audit 2024-02-10T08:34:56.050589+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:56.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:56 smithi040 bash[35794]: audit 2024-02-10T08:34:56.046842+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:56 smithi040 bash[38951]: audit 2024-02-10T08:34:56.046842+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:34:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:56 smithi040 bash[38951]: audit 2024-02-10T08:34:56.049888+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:56 smithi040 bash[38951]: audit 2024-02-10T08:34:56.050589+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:56.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:56 smithi040 bash[35794]: audit 2024-02-10T08:34:56.049888+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:34:56.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:56 smithi040 bash[35794]: audit 2024-02-10T08:34:56.050589+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:34:57.214 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:56 smithi145 bash[39917]: debug 2024-02-10T08:34:56.925+0000 7fb008c8dec0 -1 Falling back to public interface 2024-02-10T08:34:57.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:57 smithi145 bash[35820]: cluster 2024-02-10T08:34:56.169522+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:57.597 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi145:vg_nvme/lv_2 2024-02-10T08:34:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:57 smithi040 bash[35794]: cluster 2024-02-10T08:34:56.169522+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:57 smithi040 bash[38951]: cluster 2024-02-10T08:34:56.169522+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:57.782 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:57 smithi145 bash[39917]: debug 2024-02-10T08:34:57.477+0000 7fb008c8dec0 -1 osd.5 0 log_to_monitors {default=true} 2024-02-10T08:34:58.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:58 smithi145 bash[35820]: audit 2024-02-10T08:34:57.479917+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:34:58.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:58 smithi145 bash[35820]: audit 2024-02-10T08:34:57.480378+0000 mon.a (mon.0) 363 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:34:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:58 smithi040 bash[35794]: audit 2024-02-10T08:34:57.479917+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:34:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:58 smithi040 bash[35794]: audit 2024-02-10T08:34:57.480378+0000 mon.a (mon.0) 363 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:34:58.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:58 smithi040 bash[38951]: audit 2024-02-10T08:34:57.479917+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:34:58.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:58 smithi040 bash[38951]: audit 2024-02-10T08:34:57.480378+0000 mon.a (mon.0) 363 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T08:34:59.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[39917]: debug 2024-02-10T08:34:59.253+0000 7faff1a42700 -1 osd.5 0 waiting for initial osdmap 2024-02-10T08:34:59.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[39917]: debug 2024-02-10T08:34:59.259+0000 7faffcc5e700 -1 osd.5 35 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-10T08:34:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[35820]: cluster 2024-02-10T08:34:58.169973+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[35820]: audit 2024-02-10T08:34:58.247798+0000 mon.a (mon.0) 364 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T08:34:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[35820]: cluster 2024-02-10T08:34:58.247854+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-10T08:34:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[35820]: audit 2024-02-10T08:34:58.248025+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:34:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[35820]: audit 2024-02-10T08:34:58.249330+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:34:59 smithi145 bash[35820]: audit 2024-02-10T08:34:58.249643+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[35794]: cluster 2024-02-10T08:34:58.169973+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[35794]: audit 2024-02-10T08:34:58.247798+0000 mon.a (mon.0) 364 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T08:34:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[35794]: cluster 2024-02-10T08:34:58.247854+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[35794]: audit 2024-02-10T08:34:58.248025+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[35794]: audit 2024-02-10T08:34:58.249330+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[35794]: audit 2024-02-10T08:34:58.249643+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[38951]: cluster 2024-02-10T08:34:58.169973+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[38951]: audit 2024-02-10T08:34:58.247798+0000 mon.a (mon.0) 364 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[38951]: cluster 2024-02-10T08:34:58.247854+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[38951]: audit 2024-02-10T08:34:58.248025+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[38951]: audit 2024-02-10T08:34:58.249330+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:34:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:34:59 smithi040 bash[38951]: audit 2024-02-10T08:34:58.249643+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:00 smithi145 bash[35820]: cluster 2024-02-10T08:34:58.515946+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:00 smithi145 bash[35820]: cluster 2024-02-10T08:34:58.516025+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:00 smithi145 bash[35820]: audit 2024-02-10T08:34:59.251865+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:00 smithi145 bash[35820]: cluster 2024-02-10T08:34:59.251910+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-10T08:35:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:00 smithi145 bash[35820]: audit 2024-02-10T08:34:59.252094+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:35:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:00 smithi145 bash[35820]: cluster 2024-02-10T08:35:00.170462+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:35:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[35794]: cluster 2024-02-10T08:34:58.515946+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[35794]: cluster 2024-02-10T08:34:58.516025+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[35794]: audit 2024-02-10T08:34:59.251865+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[35794]: cluster 2024-02-10T08:34:59.251910+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[35794]: audit 2024-02-10T08:34:59.252094+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[35794]: cluster 2024-02-10T08:35:00.170462+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[38951]: cluster 2024-02-10T08:34:58.515946+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[38951]: cluster 2024-02-10T08:34:58.516025+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[38951]: audit 2024-02-10T08:34:59.251865+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[38951]: cluster 2024-02-10T08:34:59.251910+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-10T08:35:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[38951]: audit 2024-02-10T08:34:59.252094+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:35:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:00 smithi040 bash[38951]: cluster 2024-02-10T08:35:00.170462+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-10T08:35:01.362 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: cluster 2024-02-10T08:35:00.256479+0000 mon.a (mon.0) 371 : cluster [INF] osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972] boot 2024-02-10T08:35:01.362 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: cluster 2024-02-10T08:35:00.256538+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-10T08:35:01.362 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: audit 2024-02-10T08:35:00.256849+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:35:01.362 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: audit 2024-02-10T08:35:00.869348+0000 mgr.y (mgr.14140) 124 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:01.362 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: cephadm 2024-02-10T08:35:00.870156+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:35:01.362 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: audit 2024-02-10T08:35:00.870477+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:35:01.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: audit 2024-02-10T08:35:00.871267+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:01.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: audit 2024-02-10T08:35:00.872482+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:01.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:01 smithi145 bash[35820]: audit 2024-02-10T08:35:01.118083+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: cluster 2024-02-10T08:35:00.256479+0000 mon.a (mon.0) 371 : cluster [INF] osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972] boot 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: cluster 2024-02-10T08:35:00.256538+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: audit 2024-02-10T08:35:00.256849+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: audit 2024-02-10T08:35:00.869348+0000 mgr.y (mgr.14140) 124 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: cephadm 2024-02-10T08:35:00.870156+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: audit 2024-02-10T08:35:00.870477+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: audit 2024-02-10T08:35:00.871267+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: audit 2024-02-10T08:35:00.872482+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[35794]: audit 2024-02-10T08:35:01.118083+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: cluster 2024-02-10T08:35:00.256479+0000 mon.a (mon.0) 371 : cluster [INF] osd.5 [v2:172.21.15.145:6808/1574967972,v1:172.21.15.145:6809/1574967972] boot 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: cluster 2024-02-10T08:35:00.256538+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: audit 2024-02-10T08:35:00.256849+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:35:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: audit 2024-02-10T08:35:00.869348+0000 mgr.y (mgr.14140) 124 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: cephadm 2024-02-10T08:35:00.870156+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:35:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: audit 2024-02-10T08:35:00.870477+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:35:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: audit 2024-02-10T08:35:00.871267+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: audit 2024-02-10T08:35:00.872482+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:01 smithi040 bash[38951]: audit 2024-02-10T08:35:01.118083+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:02.499 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:02 smithi145 bash[35820]: cluster 2024-02-10T08:35:01.263305+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-10T08:35:02.499 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:02 smithi145 bash[35820]: audit 2024-02-10T08:35:01.302647+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:02.499 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:02 smithi145 bash[35820]: audit 2024-02-10T08:35:01.305675+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:02.499 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:02 smithi145 bash[35820]: cluster 2024-02-10T08:35:02.170825+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[35794]: cluster 2024-02-10T08:35:01.263305+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-10T08:35:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[38951]: cluster 2024-02-10T08:35:01.263305+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-10T08:35:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[35794]: audit 2024-02-10T08:35:01.302647+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[35794]: audit 2024-02-10T08:35:01.305675+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[35794]: cluster 2024-02-10T08:35:02.170825+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[38951]: audit 2024-02-10T08:35:01.302647+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:02.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[38951]: audit 2024-02-10T08:35:01.305675+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}}, \"last_daemon_update\": \"2024-02-10T08:34:56.046148\", \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:02.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:02 smithi040 bash[38951]: cluster 2024-02-10T08:35:02.170825+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:03 smithi145 bash[35820]: cluster 2024-02-10T08:35:02.303964+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:35:03.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:03 smithi040 bash[35794]: cluster 2024-02-10T08:35:02.303964+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:35:03.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:03 smithi040 bash[38951]: cluster 2024-02-10T08:35:02.303964+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:35:04.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: audit 2024-02-10T08:35:03.463568+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.145:0/2067169833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]: dispatch 2024-02-10T08:35:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: audit 2024-02-10T08:35:03.464139+0000 mon.a (mon.0) 382 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]: dispatch 2024-02-10T08:35:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: audit 2024-02-10T08:35:03.470524+0000 mon.a (mon.0) 383 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]': finished 2024-02-10T08:35:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: cluster 2024-02-10T08:35:03.470569+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-10T08:35:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: audit 2024-02-10T08:35:03.470737+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: cluster 2024-02-10T08:35:04.171250+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:04 smithi145 bash[35820]: audit 2024-02-10T08:35:04.186771+0000 mon.b (mon.2) 13 : audit [DBG] from='client.? 172.21.15.145:0/1193204515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:35:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: audit 2024-02-10T08:35:03.463568+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.145:0/2067169833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]: dispatch 2024-02-10T08:35:04.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: audit 2024-02-10T08:35:03.464139+0000 mon.a (mon.0) 382 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]: dispatch 2024-02-10T08:35:04.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: audit 2024-02-10T08:35:03.470524+0000 mon.a (mon.0) 383 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]': finished 2024-02-10T08:35:04.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: cluster 2024-02-10T08:35:03.470569+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-10T08:35:04.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: audit 2024-02-10T08:35:03.470737+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:04.717 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: cluster 2024-02-10T08:35:04.171250+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:04.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[35794]: audit 2024-02-10T08:35:04.186771+0000 mon.b (mon.2) 13 : audit [DBG] from='client.? 172.21.15.145:0/1193204515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:35:04.718 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: audit 2024-02-10T08:35:03.463568+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.145:0/2067169833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]: dispatch 2024-02-10T08:35:04.718 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: audit 2024-02-10T08:35:03.464139+0000 mon.a (mon.0) 382 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]: dispatch 2024-02-10T08:35:04.718 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: audit 2024-02-10T08:35:03.470524+0000 mon.a (mon.0) 383 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b66a495-8002-4920-a6b2-c8a2ddf2f530"}]': finished 2024-02-10T08:35:04.718 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: cluster 2024-02-10T08:35:03.470569+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-10T08:35:04.718 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: audit 2024-02-10T08:35:03.470737+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:04.719 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: cluster 2024-02-10T08:35:04.171250+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:04.719 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:04 smithi040 bash[38951]: audit 2024-02-10T08:35:04.186771+0000 mon.b (mon.2) 13 : audit [DBG] from='client.? 172.21.15.145:0/1193204515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:35:07.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:07 smithi040 bash[38951]: cluster 2024-02-10T08:35:06.171846+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:07 smithi040 bash[38951]: audit 2024-02-10T08:35:06.835953+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:07 smithi040 bash[35794]: cluster 2024-02-10T08:35:06.171846+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:07 smithi040 bash[35794]: audit 2024-02-10T08:35:06.835953+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:07.493 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:07 smithi145 bash[35820]: cluster 2024-02-10T08:35:06.171846+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:07.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:07 smithi145 bash[35820]: audit 2024-02-10T08:35:06.835953+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:08.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:08 smithi145 bash[35820]: cluster 2024-02-10T08:35:08.172258+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:08.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:08 smithi145 bash[35820]: cluster 2024-02-10T08:35:08.222911+0000 mon.a (mon.0) 387 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:35:08.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:08 smithi145 bash[35820]: cluster 2024-02-10T08:35:08.222974+0000 mon.a (mon.0) 388 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:08 smithi040 bash[35794]: cluster 2024-02-10T08:35:08.172258+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:08 smithi040 bash[35794]: cluster 2024-02-10T08:35:08.222911+0000 mon.a (mon.0) 387 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:35:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:08 smithi040 bash[35794]: cluster 2024-02-10T08:35:08.222974+0000 mon.a (mon.0) 388 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:08 smithi040 bash[38951]: cluster 2024-02-10T08:35:08.172258+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:08 smithi040 bash[38951]: cluster 2024-02-10T08:35:08.222911+0000 mon.a (mon.0) 387 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:35:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:08 smithi040 bash[38951]: cluster 2024-02-10T08:35:08.222974+0000 mon.a (mon.0) 388 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:09 smithi145 bash[35820]: audit 2024-02-10T08:35:09.689970+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T08:35:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:09 smithi145 bash[35820]: audit 2024-02-10T08:35:09.690845+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:09 smithi145 bash[35820]: audit 2024-02-10T08:35:09.691888+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-10T08:35:10.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:09 smithi040 bash[35794]: audit 2024-02-10T08:35:09.689970+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T08:35:10.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:09 smithi040 bash[35794]: audit 2024-02-10T08:35:09.690845+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:10.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:09 smithi040 bash[35794]: audit 2024-02-10T08:35:09.691888+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-10T08:35:10.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:09 smithi040 bash[38951]: audit 2024-02-10T08:35:09.689970+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T08:35:10.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:09 smithi040 bash[38951]: audit 2024-02-10T08:35:09.690845+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:10.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:09 smithi040 bash[38951]: audit 2024-02-10T08:35:09.691888+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-10T08:35:11.001 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:10 smithi145 bash[35820]: cephadm 2024-02-10T08:35:09.691492+0000 mgr.y (mgr.14140) 130 : cephadm [INF] Deploying daemon osd.6 on smithi145 2024-02-10T08:35:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:10 smithi145 bash[35820]: cluster 2024-02-10T08:35:10.172653+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:11.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:10 smithi040 bash[35794]: cephadm 2024-02-10T08:35:09.691492+0000 mgr.y (mgr.14140) 130 : cephadm [INF] Deploying daemon osd.6 on smithi145 2024-02-10T08:35:11.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:10 smithi040 bash[35794]: cluster 2024-02-10T08:35:10.172653+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:11.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:10 smithi040 bash[38951]: cephadm 2024-02-10T08:35:09.691492+0000 mgr.y (mgr.14140) 130 : cephadm [INF] Deploying daemon osd.6 on smithi145 2024-02-10T08:35:11.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:10 smithi040 bash[38951]: cluster 2024-02-10T08:35:10.172653+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:11.465 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 6 on host 'smithi145' 2024-02-10T08:35:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:12 smithi040 bash[35794]: audit 2024-02-10T08:35:11.456528+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:12 smithi040 bash[35794]: audit 2024-02-10T08:35:11.457044+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:12 smithi040 bash[35794]: audit 2024-02-10T08:35:11.461896+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:12.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:12 smithi040 bash[38951]: audit 2024-02-10T08:35:11.456528+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:12.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:12 smithi040 bash[38951]: audit 2024-02-10T08:35:11.457044+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:12.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:12 smithi040 bash[38951]: audit 2024-02-10T08:35:11.461896+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:12.451 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:12 smithi145 bash[35820]: audit 2024-02-10T08:35:11.456528+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:12.451 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:12 smithi145 bash[35820]: audit 2024-02-10T08:35:11.457044+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:12.452 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:12 smithi145 bash[35820]: audit 2024-02-10T08:35:11.461896+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045888\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.045985\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046022\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:56.046056\", \"created\": \"2024-02-10T08:34:52.119116\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_device_update\": \"2024-02-10T08:35:01.301989\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:13.234 DEBUG:teuthology.orchestra.run.smithi145:osd.6> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.6.service 2024-02-10T08:35:13.236 INFO:tasks.cephadm:Deploying osd.7 on smithi145 with /dev/vg_nvme/lv_1... 2024-02-10T08:35:13.237 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-10T08:35:13.268 INFO:journalctl@ceph.osd.6.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:35:13.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:13 smithi040 bash[35794]: cluster 2024-02-10T08:35:12.172990+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:13.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:13 smithi040 bash[38951]: cluster 2024-02-10T08:35:12.172990+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:13.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:13 smithi145 bash[35820]: cluster 2024-02-10T08:35:12.172990+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:15.476 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 08:35:15 smithi145 bash[41353]: debug 2024-02-10T08:35:15.170+0000 7f3bfcb86ec0 -1 Falling back to public interface 2024-02-10T08:35:15.476 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:15 smithi145 bash[35820]: cluster 2024-02-10T08:35:14.173360+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:15.476 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:15 smithi145 bash[35820]: audit 2024-02-10T08:35:15.186106+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:15.476 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:15 smithi145 bash[35820]: audit 2024-02-10T08:35:15.189924+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:15 smithi040 bash[35794]: cluster 2024-02-10T08:35:14.173360+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:15 smithi040 bash[35794]: audit 2024-02-10T08:35:15.186106+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:15 smithi040 bash[35794]: audit 2024-02-10T08:35:15.189924+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:15 smithi040 bash[38951]: cluster 2024-02-10T08:35:14.173360+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:15 smithi040 bash[38951]: audit 2024-02-10T08:35:15.186106+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:15 smithi040 bash[38951]: audit 2024-02-10T08:35:15.189924+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:15.752 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 08:35:15 smithi145 bash[41353]: debug 2024-02-10T08:35:15.723+0000 7f3bfcb86ec0 -1 osd.6 0 log_to_monitors {default=true} 2024-02-10T08:35:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:16 smithi145 bash[35820]: audit 2024-02-10T08:35:15.406941+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:16 smithi145 bash[35820]: audit 2024-02-10T08:35:15.410027+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:16 smithi145 bash[35820]: audit 2024-02-10T08:35:15.410711+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:16 smithi145 bash[35820]: audit 2024-02-10T08:35:15.727316+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:35:16.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:16 smithi145 bash[35820]: audit 2024-02-10T08:35:15.727715+0000 mon.a (mon.0) 400 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:35:16.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[35794]: audit 2024-02-10T08:35:15.406941+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:16.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[38951]: audit 2024-02-10T08:35:15.406941+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[35794]: audit 2024-02-10T08:35:15.410027+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[35794]: audit 2024-02-10T08:35:15.410711+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[35794]: audit 2024-02-10T08:35:15.727316+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[35794]: audit 2024-02-10T08:35:15.727715+0000 mon.a (mon.0) 400 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[38951]: audit 2024-02-10T08:35:15.410027+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[38951]: audit 2024-02-10T08:35:15.410711+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[38951]: audit 2024-02-10T08:35:15.727316+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:35:16.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:16 smithi040 bash[38951]: audit 2024-02-10T08:35:15.727715+0000 mon.a (mon.0) 400 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T08:35:16.711 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-10T08:35:16.712 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-10T08:35:16.712 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-02-10T08:35:16.712 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-02-10T08:35:16.712 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012025 s, 872 MB/s 2024-02-10T08:35:16.712 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-02-10T08:35:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[35820]: cluster 2024-02-10T08:35:16.173824+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[35820]: audit 2024-02-10T08:35:16.418747+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T08:35:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[35820]: cluster 2024-02-10T08:35:16.418821+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-10T08:35:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[35820]: audit 2024-02-10T08:35:16.418987+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[35820]: audit 2024-02-10T08:35:16.419763+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[35820]: audit 2024-02-10T08:35:16.420107+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:17.382 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch daemon add osd smithi145:vg_nvme/lv_1 2024-02-10T08:35:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[35794]: cluster 2024-02-10T08:35:16.173824+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[35794]: audit 2024-02-10T08:35:16.418747+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[35794]: cluster 2024-02-10T08:35:16.418821+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[35794]: audit 2024-02-10T08:35:16.418987+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[35794]: audit 2024-02-10T08:35:16.419763+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[35794]: audit 2024-02-10T08:35:16.420107+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[38951]: cluster 2024-02-10T08:35:16.173824+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[38951]: audit 2024-02-10T08:35:16.418747+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[38951]: cluster 2024-02-10T08:35:16.418821+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[38951]: audit 2024-02-10T08:35:16.418987+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[38951]: audit 2024-02-10T08:35:16.419763+0000 mon.b (mon.2) 15 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:17 smithi040 bash[38951]: audit 2024-02-10T08:35:16.420107+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:17.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[41353]: debug 2024-02-10T08:35:17.420+0000 7f3be1933700 -1 osd.6 0 waiting for initial osdmap 2024-02-10T08:35:17.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 08:35:17 smithi145 bash[41353]: debug 2024-02-10T08:35:17.425+0000 7f3becb4f700 -1 osd.6 40 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-10T08:35:18.481 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:18 smithi145 bash[35820]: cluster 2024-02-10T08:35:16.753059+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:18.481 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:18 smithi145 bash[35820]: cluster 2024-02-10T08:35:16.753087+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:18.481 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:18 smithi145 bash[35820]: audit 2024-02-10T08:35:17.419253+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:18.481 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:18 smithi145 bash[35820]: cluster 2024-02-10T08:35:17.419304+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-10T08:35:18.481 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:18 smithi145 bash[35820]: audit 2024-02-10T08:35:17.419478+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:18.481 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:18 smithi145 bash[35820]: cluster 2024-02-10T08:35:18.174354+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[35794]: cluster 2024-02-10T08:35:16.753059+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[35794]: cluster 2024-02-10T08:35:16.753087+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[35794]: audit 2024-02-10T08:35:17.419253+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[35794]: cluster 2024-02-10T08:35:17.419304+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[35794]: audit 2024-02-10T08:35:17.419478+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[35794]: cluster 2024-02-10T08:35:18.174354+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[38951]: cluster 2024-02-10T08:35:16.753059+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[38951]: cluster 2024-02-10T08:35:16.753087+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[38951]: audit 2024-02-10T08:35:17.419253+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[38951]: cluster 2024-02-10T08:35:17.419304+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-10T08:35:18.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[38951]: audit 2024-02-10T08:35:17.419478+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:18.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:18 smithi040 bash[38951]: cluster 2024-02-10T08:35:18.174354+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-10T08:35:19.674 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:19 smithi145 bash[35820]: cluster 2024-02-10T08:35:18.425468+0000 mon.a (mon.0) 408 : cluster [INF] osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518] boot 2024-02-10T08:35:19.675 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:19 smithi145 bash[35820]: cluster 2024-02-10T08:35:18.425539+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-10T08:35:19.675 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:19 smithi145 bash[35820]: audit 2024-02-10T08:35:18.425914+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:19.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:19 smithi040 bash[35794]: cluster 2024-02-10T08:35:18.425468+0000 mon.a (mon.0) 408 : cluster [INF] osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518] boot 2024-02-10T08:35:19.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:19 smithi040 bash[35794]: cluster 2024-02-10T08:35:18.425539+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-10T08:35:19.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:19 smithi040 bash[35794]: audit 2024-02-10T08:35:18.425914+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:19.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:19 smithi040 bash[38951]: cluster 2024-02-10T08:35:18.425468+0000 mon.a (mon.0) 408 : cluster [INF] osd.6 [v2:172.21.15.145:6816/725324518,v1:172.21.15.145:6817/725324518] boot 2024-02-10T08:35:19.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:19 smithi040 bash[38951]: cluster 2024-02-10T08:35:18.425539+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-10T08:35:19.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:19 smithi040 bash[38951]: audit 2024-02-10T08:35:18.425914+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:35:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:20 smithi145 bash[35820]: cluster 2024-02-10T08:35:19.426654+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-10T08:35:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:20 smithi145 bash[35820]: cluster 2024-02-10T08:35:20.174879+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v140: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:20.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:20 smithi040 bash[35794]: cluster 2024-02-10T08:35:19.426654+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-10T08:35:20.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:20 smithi040 bash[35794]: cluster 2024-02-10T08:35:20.174879+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v140: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:20.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:20 smithi040 bash[38951]: cluster 2024-02-10T08:35:19.426654+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-10T08:35:20.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:20 smithi040 bash[38951]: cluster 2024-02-10T08:35:20.174879+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v140: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: cluster 2024-02-10T08:35:20.430480+0000 mon.a (mon.0) 412 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:35:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.549807+0000 mgr.y (mgr.14140) 137 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: cephadm 2024-02-10T08:35:20.550584+0000 mgr.y (mgr.14140) 138 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.550879+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.551647+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.552897+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.673634+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.863207+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:21.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:21 smithi145 bash[35820]: audit 2024-02-10T08:35:20.866620+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: cluster 2024-02-10T08:35:20.430480+0000 mon.a (mon.0) 412 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.549807+0000 mgr.y (mgr.14140) 137 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: cephadm 2024-02-10T08:35:20.550584+0000 mgr.y (mgr.14140) 138 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.550879+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.551647+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.552897+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:21.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.673634+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: cluster 2024-02-10T08:35:20.430480+0000 mon.a (mon.0) 412 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.549807+0000 mgr.y (mgr.14140) 137 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: cephadm 2024-02-10T08:35:20.550584+0000 mgr.y (mgr.14140) 138 : cephadm [INF] Applying osd on host smithi145... 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.550879+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.551647+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.552897+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:21.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.673634+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:21.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.863207+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:21.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[35794]: audit 2024-02-10T08:35:20.866620+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:21.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.863207+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:21.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:21 smithi040 bash[38951]: audit 2024-02-10T08:35:20.866620+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}}, \"last_daemon_update\": \"2024-02-10T08:35:15.406270\", \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:22 smithi145 bash[35820]: cluster 2024-02-10T08:35:22.175408+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v141: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:22.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:22 smithi040 bash[35794]: cluster 2024-02-10T08:35:22.175408+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v141: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:22.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:22 smithi040 bash[38951]: cluster 2024-02-10T08:35:22.175408+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v141: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:23 smithi145 bash[35820]: audit 2024-02-10T08:35:22.981266+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.145:0/1913771772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]: dispatch 2024-02-10T08:35:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:23 smithi145 bash[35820]: audit 2024-02-10T08:35:22.981882+0000 mon.a (mon.0) 419 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]: dispatch 2024-02-10T08:35:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:23 smithi145 bash[35820]: audit 2024-02-10T08:35:22.986214+0000 mon.a (mon.0) 420 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]': finished 2024-02-10T08:35:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:23 smithi145 bash[35820]: cluster 2024-02-10T08:35:22.986266+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-10T08:35:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:23 smithi145 bash[35820]: audit 2024-02-10T08:35:22.986458+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[35794]: audit 2024-02-10T08:35:22.981266+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.145:0/1913771772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]: dispatch 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[35794]: audit 2024-02-10T08:35:22.981882+0000 mon.a (mon.0) 419 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]: dispatch 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[35794]: audit 2024-02-10T08:35:22.986214+0000 mon.a (mon.0) 420 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]': finished 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[35794]: cluster 2024-02-10T08:35:22.986266+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[35794]: audit 2024-02-10T08:35:22.986458+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[38951]: audit 2024-02-10T08:35:22.981266+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.145:0/1913771772' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]: dispatch 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[38951]: audit 2024-02-10T08:35:22.981882+0000 mon.a (mon.0) 419 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]: dispatch 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[38951]: audit 2024-02-10T08:35:22.986214+0000 mon.a (mon.0) 420 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0"}]': finished 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[38951]: cluster 2024-02-10T08:35:22.986266+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-10T08:35:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:23 smithi040 bash[38951]: audit 2024-02-10T08:35:22.986458+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:24 smithi145 bash[35820]: audit 2024-02-10T08:35:23.732793+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.145:0/2434504604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:35:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:24 smithi145 bash[35820]: cluster 2024-02-10T08:35:24.175908+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v143: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:24 smithi040 bash[35794]: audit 2024-02-10T08:35:23.732793+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.145:0/2434504604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:35:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:24 smithi040 bash[35794]: cluster 2024-02-10T08:35:24.175908+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v143: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:24 smithi040 bash[38951]: audit 2024-02-10T08:35:23.732793+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.145:0/2434504604' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-10T08:35:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:24 smithi040 bash[38951]: cluster 2024-02-10T08:35:24.175908+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v143: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:27 smithi040 bash[35794]: cluster 2024-02-10T08:35:26.176355+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:27 smithi040 bash[35794]: audit 2024-02-10T08:35:26.282982+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:27 smithi040 bash[38951]: cluster 2024-02-10T08:35:26.176355+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:27 smithi040 bash[38951]: audit 2024-02-10T08:35:26.282982+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:27 smithi145 bash[35820]: cluster 2024-02-10T08:35:26.176355+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:27 smithi145 bash[35820]: audit 2024-02-10T08:35:26.282982+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:28 smithi145 bash[35820]: cluster 2024-02-10T08:35:27.096621+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:35:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:28 smithi145 bash[35820]: cluster 2024-02-10T08:35:27.096653+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:28 smithi040 bash[35794]: cluster 2024-02-10T08:35:27.096621+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:35:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:28 smithi040 bash[35794]: cluster 2024-02-10T08:35:27.096653+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:28.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:28 smithi040 bash[38951]: cluster 2024-02-10T08:35:27.096621+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-10T08:35:28.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:28 smithi040 bash[38951]: cluster 2024-02-10T08:35:27.096653+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-02-10T08:35:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:29 smithi145 bash[35820]: cluster 2024-02-10T08:35:28.176819+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:29 smithi145 bash[35820]: audit 2024-02-10T08:35:29.030487+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T08:35:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:29 smithi145 bash[35820]: audit 2024-02-10T08:35:29.031320+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:29 smithi145 bash[35820]: audit 2024-02-10T08:35:29.032213+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-10T08:35:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[35794]: cluster 2024-02-10T08:35:28.176819+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[35794]: audit 2024-02-10T08:35:29.030487+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T08:35:29.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[35794]: audit 2024-02-10T08:35:29.031320+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:29.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[35794]: audit 2024-02-10T08:35:29.032213+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-10T08:35:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[38951]: cluster 2024-02-10T08:35:28.176819+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[38951]: audit 2024-02-10T08:35:29.030487+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T08:35:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[38951]: audit 2024-02-10T08:35:29.031320+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:35:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:29 smithi040 bash[38951]: audit 2024-02-10T08:35:29.032213+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-10T08:35:30.372 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:30 smithi145 bash[35820]: cephadm 2024-02-10T08:35:29.031908+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Deploying daemon osd.7 on smithi145 2024-02-10T08:35:30.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:30 smithi040 bash[35794]: cephadm 2024-02-10T08:35:29.031908+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Deploying daemon osd.7 on smithi145 2024-02-10T08:35:30.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:30 smithi040 bash[38951]: cephadm 2024-02-10T08:35:29.031908+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Deploying daemon osd.7 on smithi145 2024-02-10T08:35:30.895 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 7 on host 'smithi145' 2024-02-10T08:35:31.423 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:31 smithi145 bash[35820]: cluster 2024-02-10T08:35:30.177351+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:31.424 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:31 smithi145 bash[35820]: audit 2024-02-10T08:35:30.888321+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:31.424 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:31 smithi145 bash[35820]: audit 2024-02-10T08:35:30.888796+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:31.424 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:31 smithi145 bash[35820]: audit 2024-02-10T08:35:30.892123+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:31.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[35794]: cluster 2024-02-10T08:35:30.177351+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:31.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[38951]: cluster 2024-02-10T08:35:30.177351+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:31.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[38951]: audit 2024-02-10T08:35:30.888321+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:31.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[38951]: audit 2024-02-10T08:35:30.888796+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:31.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[38951]: audit 2024-02-10T08:35:30.892123+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[35794]: audit 2024-02-10T08:35:30.888321+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:31.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[35794]: audit 2024-02-10T08:35:30.888796+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:31.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:31 smithi040 bash[35794]: audit 2024-02-10T08:35:30.892123+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.405965\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406058\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406112\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406147\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:15.406179\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_device_update\": \"2024-02-10T08:35:20.862524\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:31.701 DEBUG:teuthology.orchestra.run.smithi145:osd.7> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.7.service 2024-02-10T08:35:31.703 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-10T08:35:31.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd stat -f json 2024-02-10T08:35:31.733 INFO:journalctl@ceph.osd.7.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:35:32.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-10T08:35:32.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-02-10T08:35:32.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-02-10T08:35:32.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-02-10T08:35:32.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-10T08:35:32.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-10T08:35:32.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:32 smithi145 bash[42647]: --> ceph-volume lvm activate successful for osd ID: 7 2024-02-10T08:35:33.368 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:33 smithi040 bash[35794]: cluster 2024-02-10T08:35:32.177670+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:33.369 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:33 smithi040 bash[38951]: cluster 2024-02-10T08:35:32.177670+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:33 smithi145 bash[35820]: cluster 2024-02-10T08:35:32.177670+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:33.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[35794]: audit 2024-02-10T08:35:33.815484+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[35794]: audit 2024-02-10T08:35:33.818321+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[35794]: audit 2024-02-10T08:35:33.818943+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[35794]: audit 2024-02-10T08:35:33.998114+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/2169219017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[38951]: audit 2024-02-10T08:35:33.815484+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[38951]: audit 2024-02-10T08:35:33.818321+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:34.419 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[38951]: audit 2024-02-10T08:35:33.818943+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:34.420 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:34 smithi040 bash[38951]: audit 2024-02-10T08:35:33.998114+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/2169219017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:35:34.425 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:34 smithi145 bash[42892]: debug 2024-02-10T08:35:34.111+0000 7f7193b0aec0 -1 Falling back to public interface 2024-02-10T08:35:34.426 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:34 smithi145 bash[35820]: audit 2024-02-10T08:35:33.815484+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:34.426 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:34 smithi145 bash[35820]: audit 2024-02-10T08:35:33.818321+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:34.426 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:34 smithi145 bash[35820]: audit 2024-02-10T08:35:33.818943+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-10T08:35:34.426 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:34 smithi145 bash[35820]: audit 2024-02-10T08:35:33.998114+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/2169219017' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:35:34.782 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:34 smithi145 bash[42892]: debug 2024-02-10T08:35:34.661+0000 7f7193b0aec0 -1 osd.7 0 log_to_monitors {default=true} 2024-02-10T08:35:34.833 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1707554118,"num_in_osds":7,"osd_in_since":1707554118,"num_remapped_pgs":0} 2024-02-10T08:35:35.512 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:35 smithi145 bash[35820]: cluster 2024-02-10T08:35:34.177971+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:35.512 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:35 smithi145 bash[35820]: audit 2024-02-10T08:35:34.664539+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:35:35.512 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:35 smithi145 bash[35820]: audit 2024-02-10T08:35:34.665096+0000 mon.a (mon.0) 435 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:35:35.513 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:35 smithi145 bash[35820]: audit 2024-02-10T08:35:35.191411+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:35.513 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:35 smithi145 bash[35820]: audit 2024-02-10T08:35:35.197041+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[35794]: cluster 2024-02-10T08:35:34.177971+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[35794]: audit 2024-02-10T08:35:34.664539+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[35794]: audit 2024-02-10T08:35:34.665096+0000 mon.a (mon.0) 435 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[35794]: audit 2024-02-10T08:35:35.191411+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[35794]: audit 2024-02-10T08:35:35.197041+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[38951]: cluster 2024-02-10T08:35:34.177971+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[38951]: audit 2024-02-10T08:35:34.664539+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:35:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[38951]: audit 2024-02-10T08:35:34.665096+0000 mon.a (mon.0) 435 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T08:35:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[38951]: audit 2024-02-10T08:35:35.191411+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:35 smithi040 bash[38951]: audit 2024-02-10T08:35:35.197041+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:35.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd stat -f json 2024-02-10T08:35:36.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[42892]: debug 2024-02-10T08:35:36.249+0000 7f71788b7700 -1 osd.7 0 waiting for initial osdmap 2024-02-10T08:35:36.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[42892]: debug 2024-02-10T08:35:36.255+0000 7f7183ad3700 -1 osd.7 45 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: audit 2024-02-10T08:35:35.238322+0000 mon.a (mon.0) 438 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: cluster 2024-02-10T08:35:35.238380+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: audit 2024-02-10T08:35:35.238798+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: audit 2024-02-10T08:35:35.239358+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: audit 2024-02-10T08:35:35.239893+0000 mon.a (mon.0) 441 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: cluster 2024-02-10T08:35:35.653746+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:36 smithi145 bash[35820]: cluster 2024-02-10T08:35:35.653795+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:36.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: audit 2024-02-10T08:35:35.238322+0000 mon.a (mon.0) 438 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:35:36.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: cluster 2024-02-10T08:35:35.238380+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-10T08:35:36.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: audit 2024-02-10T08:35:35.238798+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:36.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: audit 2024-02-10T08:35:35.239358+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:36.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: audit 2024-02-10T08:35:35.239893+0000 mon.a (mon.0) 441 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: cluster 2024-02-10T08:35:35.653746+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[35794]: cluster 2024-02-10T08:35:35.653795+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: audit 2024-02-10T08:35:35.238322+0000 mon.a (mon.0) 438 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: cluster 2024-02-10T08:35:35.238380+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: audit 2024-02-10T08:35:35.238798+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: audit 2024-02-10T08:35:35.239358+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: audit 2024-02-10T08:35:35.239893+0000 mon.a (mon.0) 441 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: cluster 2024-02-10T08:35:35.653746+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-10T08:35:36.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:36 smithi040 bash[38951]: cluster 2024-02-10T08:35:35.653795+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: cluster 2024-02-10T08:35:36.178295+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: audit 2024-02-10T08:35:36.246775+0000 mon.a (mon.0) 442 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: cluster 2024-02-10T08:35:36.246831+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: audit 2024-02-10T08:35:36.247443+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: audit 2024-02-10T08:35:37.046257+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: cluster 2024-02-10T08:35:36.178295+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: audit 2024-02-10T08:35:36.246775+0000 mon.a (mon.0) 442 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: cluster 2024-02-10T08:35:36.246831+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: audit 2024-02-10T08:35:36.247443+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: audit 2024-02-10T08:35:37.046257+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: audit 2024-02-10T08:35:37.229599+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: audit 2024-02-10T08:35:37.232830+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: cluster 2024-02-10T08:35:37.243265+0000 mon.a (mon.0) 448 : cluster [INF] osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144] boot 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: cluster 2024-02-10T08:35:37.243314+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-10T08:35:37.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[35794]: audit 2024-02-10T08:35:37.243490+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:37.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: audit 2024-02-10T08:35:37.229599+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:37.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: audit 2024-02-10T08:35:37.232830+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:37.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: cluster 2024-02-10T08:35:37.243265+0000 mon.a (mon.0) 448 : cluster [INF] osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144] boot 2024-02-10T08:35:37.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: cluster 2024-02-10T08:35:37.243314+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-10T08:35:37.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:37 smithi040 bash[38951]: audit 2024-02-10T08:35:37.243490+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: cluster 2024-02-10T08:35:36.178295+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-10T08:35:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: audit 2024-02-10T08:35:36.246775+0000 mon.a (mon.0) 442 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-02-10T08:35:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: cluster 2024-02-10T08:35:36.246831+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-10T08:35:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: audit 2024-02-10T08:35:36.247443+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: audit 2024-02-10T08:35:37.046257+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:35:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: audit 2024-02-10T08:35:37.229599+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:35:37.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: audit 2024-02-10T08:35:37.232830+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}}, \"last_daemon_update\": \"2024-02-10T08:35:33.814849\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:35:37.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: cluster 2024-02-10T08:35:37.243265+0000 mon.a (mon.0) 448 : cluster [INF] osd.7 [v2:172.21.15.145:6824/464116144,v1:172.21.15.145:6825/464116144] boot 2024-02-10T08:35:37.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: cluster 2024-02-10T08:35:37.243314+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-10T08:35:37.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:37 smithi145 bash[35820]: audit 2024-02-10T08:35:37.243490+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:35:38.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:35:38.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:38 smithi040 bash[38951]: audit 2024-02-10T08:35:38.056899+0000 mon.a (mon.0) 451 : audit [DBG] from='client.? 172.21.15.40:0/1891642794' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:35:38.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:38 smithi040 bash[38951]: cluster 2024-02-10T08:35:38.178739+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:38.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:38 smithi040 bash[38951]: cluster 2024-02-10T08:35:38.244561+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-10T08:35:38.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:38 smithi040 bash[35794]: audit 2024-02-10T08:35:38.056899+0000 mon.a (mon.0) 451 : audit [DBG] from='client.? 172.21.15.40:0/1891642794' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:35:38.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:38 smithi040 bash[35794]: cluster 2024-02-10T08:35:38.178739+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:38.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:38 smithi040 bash[35794]: cluster 2024-02-10T08:35:38.244561+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-10T08:35:38.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:38 smithi145 bash[35820]: audit 2024-02-10T08:35:38.056899+0000 mon.a (mon.0) 451 : audit [DBG] from='client.? 172.21.15.40:0/1891642794' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-10T08:35:38.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:38 smithi145 bash[35820]: cluster 2024-02-10T08:35:38.178739+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:38.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:38 smithi145 bash[35820]: cluster 2024-02-10T08:35:38.244561+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-10T08:35:39.068 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1707554137,"num_in_osds":8,"osd_in_since":1707554137,"num_remapped_pgs":0} 2024-02-10T08:35:39.069 INFO:tasks.cephadm:Adding prometheus.a on smithi145 2024-02-10T08:35:39.069 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch apply prometheus '1;smithi145=a' 2024-02-10T08:35:40.977 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled prometheus update... 2024-02-10T08:35:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:41 smithi145 bash[35820]: cluster 2024-02-10T08:35:40.179044+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:41 smithi145 bash[35820]: audit 2024-02-10T08:35:40.969822+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-10T08:35:40.969439\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-10T08:35:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:41 smithi145 bash[35820]: audit 2024-02-10T08:35:40.973206+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-10T08:35:40.969439\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-10T08:35:41.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:41 smithi040 bash[35794]: cluster 2024-02-10T08:35:40.179044+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:41.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:41 smithi040 bash[35794]: audit 2024-02-10T08:35:40.969822+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-10T08:35:40.969439\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-10T08:35:41.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:41 smithi040 bash[35794]: audit 2024-02-10T08:35:40.973206+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-10T08:35:40.969439\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-10T08:35:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:41 smithi040 bash[38951]: cluster 2024-02-10T08:35:40.179044+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:41 smithi040 bash[38951]: audit 2024-02-10T08:35:40.969822+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-10T08:35:40.969439\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-10T08:35:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:41 smithi040 bash[38951]: audit 2024-02-10T08:35:40.973206+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-10T08:35:40.969439\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-10T08:35:41.694 DEBUG:teuthology.orchestra.run.smithi145:prometheus.a> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service 2024-02-10T08:35:41.696 INFO:tasks.cephadm:Adding node-exporter.a on smithi040 2024-02-10T08:35:41.696 INFO:tasks.cephadm:Adding node-exporter.b on smithi145 2024-02-10T08:35:41.696 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch apply node-exporter '2;smithi040=a;smithi145=b' 2024-02-10T08:35:41.725 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:35:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:42 smithi145 bash[35820]: audit 2024-02-10T08:35:40.968855+0000 mgr.y (mgr.14140) 150 : audit [DBG] from='client.34319 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:42.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:42 smithi145 bash[35820]: cephadm 2024-02-10T08:35:40.969425+0000 mgr.y (mgr.14140) 151 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi145=a 2024-02-10T08:35:42.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:42 smithi145 bash[35820]: cephadm 2024-02-10T08:35:40.976854+0000 mgr.y (mgr.14140) 152 : cephadm [INF] Deploying daemon prometheus.a on smithi145 2024-02-10T08:35:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:42 smithi040 bash[35794]: audit 2024-02-10T08:35:40.968855+0000 mgr.y (mgr.14140) 150 : audit [DBG] from='client.34319 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:42 smithi040 bash[35794]: cephadm 2024-02-10T08:35:40.969425+0000 mgr.y (mgr.14140) 151 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi145=a 2024-02-10T08:35:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:42 smithi040 bash[35794]: cephadm 2024-02-10T08:35:40.976854+0000 mgr.y (mgr.14140) 152 : cephadm [INF] Deploying daemon prometheus.a on smithi145 2024-02-10T08:35:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:42 smithi040 bash[38951]: audit 2024-02-10T08:35:40.968855+0000 mgr.y (mgr.14140) 150 : audit [DBG] from='client.34319 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:42 smithi040 bash[38951]: cephadm 2024-02-10T08:35:40.969425+0000 mgr.y (mgr.14140) 151 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi145=a 2024-02-10T08:35:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:42 smithi040 bash[38951]: cephadm 2024-02-10T08:35:40.976854+0000 mgr.y (mgr.14140) 152 : cephadm [INF] Deploying daemon prometheus.a on smithi145 2024-02-10T08:35:43.271 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:43 smithi145 bash[35820]: cluster 2024-02-10T08:35:42.179516+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:43.660 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled node-exporter update... 2024-02-10T08:35:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:43 smithi040 bash[35794]: cluster 2024-02-10T08:35:42.179516+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:43 smithi040 bash[38951]: cluster 2024-02-10T08:35:42.179516+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:44.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:44 smithi145 bash[35820]: audit 2024-02-10T08:35:43.655602+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-10T08:35:43.655243\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-10T08:35:44.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:44 smithi145 bash[35820]: audit 2024-02-10T08:35:43.658925+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-10T08:35:43.655243\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-10T08:35:44.382 DEBUG:teuthology.orchestra.run.smithi040:node-exporter.a> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.a.service 2024-02-10T08:35:44.385 DEBUG:teuthology.orchestra.run.smithi145:node-exporter.b> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.b.service 2024-02-10T08:35:44.387 INFO:tasks.cephadm:Adding alertmanager.a on smithi040 2024-02-10T08:35:44.388 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch apply alertmanager '1;smithi040=a' 2024-02-10T08:35:44.417 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:35:44.423 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:35:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:44 smithi040 bash[35794]: audit 2024-02-10T08:35:43.655602+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-10T08:35:43.655243\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-10T08:35:44.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:44 smithi040 bash[35794]: audit 2024-02-10T08:35:43.658925+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-10T08:35:43.655243\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-10T08:35:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:44 smithi040 bash[38951]: audit 2024-02-10T08:35:43.655602+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-10T08:35:43.655243\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-10T08:35:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:44 smithi040 bash[38951]: audit 2024-02-10T08:35:43.658925+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-10T08:35:43.655243\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi145\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-10T08:35:45.530 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:45 smithi145 bash[35820]: audit 2024-02-10T08:35:43.654571+0000 mgr.y (mgr.14140) 154 : audit [DBG] from='client.34325 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi040=a;smithi145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:45.531 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:45 smithi145 bash[35820]: cephadm 2024-02-10T08:35:43.655221+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi040=a,smithi145=b 2024-02-10T08:35:45.531 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:45 smithi145 bash[35820]: cluster 2024-02-10T08:35:44.180025+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:45.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:45 smithi040 bash[35794]: audit 2024-02-10T08:35:43.654571+0000 mgr.y (mgr.14140) 154 : audit [DBG] from='client.34325 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi040=a;smithi145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:45.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:45 smithi040 bash[35794]: cephadm 2024-02-10T08:35:43.655221+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi040=a,smithi145=b 2024-02-10T08:35:45.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:45 smithi040 bash[35794]: cluster 2024-02-10T08:35:44.180025+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:45 smithi040 bash[38951]: audit 2024-02-10T08:35:43.654571+0000 mgr.y (mgr.14140) 154 : audit [DBG] from='client.34325 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi040=a;smithi145=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:45 smithi040 bash[38951]: cephadm 2024-02-10T08:35:43.655221+0000 mgr.y (mgr.14140) 155 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi040=a,smithi145=b 2024-02-10T08:35:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:45 smithi040 bash[38951]: cluster 2024-02-10T08:35:44.180025+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:46.468 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled alertmanager update... 2024-02-10T08:35:47.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:47 smithi145 bash[35820]: cluster 2024-02-10T08:35:46.180350+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:47.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:47 smithi145 bash[35820]: audit 2024-02-10T08:35:46.462357+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-10T08:35:46.462027\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-10T08:35:47.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:47 smithi145 bash[35820]: audit 2024-02-10T08:35:46.467768+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-10T08:35:46.462027\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-10T08:35:47.192 DEBUG:teuthology.orchestra.run.smithi040:alertmanager.a> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service 2024-02-10T08:35:47.195 INFO:tasks.cephadm:Adding grafana.a on smithi145 2024-02-10T08:35:47.195 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph orch apply grafana '1;smithi145=a' 2024-02-10T08:35:47.228 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:-- Logs begin at Sat 2024-02-10 08:21:58 UTC. -- 2024-02-10T08:35:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:47 smithi040 bash[35794]: cluster 2024-02-10T08:35:46.180350+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:47 smithi040 bash[35794]: audit 2024-02-10T08:35:46.462357+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-10T08:35:46.462027\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-10T08:35:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:47 smithi040 bash[35794]: audit 2024-02-10T08:35:46.467768+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-10T08:35:46.462027\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-10T08:35:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:47 smithi040 bash[38951]: cluster 2024-02-10T08:35:46.180350+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:47 smithi040 bash[38951]: audit 2024-02-10T08:35:46.462357+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-10T08:35:46.462027\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-10T08:35:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:47 smithi040 bash[38951]: audit 2024-02-10T08:35:46.467768+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-10T08:35:46.462027\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi040\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-10T08:35:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:48 smithi040 bash[35794]: audit 2024-02-10T08:35:46.461473+0000 mgr.y (mgr.14140) 158 : audit [DBG] from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi040=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:48 smithi040 bash[35794]: cephadm 2024-02-10T08:35:46.462013+0000 mgr.y (mgr.14140) 159 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi040=a 2024-02-10T08:35:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:48 smithi040 bash[38951]: audit 2024-02-10T08:35:46.461473+0000 mgr.y (mgr.14140) 158 : audit [DBG] from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi040=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:48 smithi040 bash[38951]: cephadm 2024-02-10T08:35:46.462013+0000 mgr.y (mgr.14140) 159 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi040=a 2024-02-10T08:35:48.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:48 smithi145 bash[35820]: audit 2024-02-10T08:35:46.461473+0000 mgr.y (mgr.14140) 158 : audit [DBG] from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi040=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:48.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:48 smithi145 bash[35820]: cephadm 2024-02-10T08:35:46.462013+0000 mgr.y (mgr.14140) 159 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi040=a 2024-02-10T08:35:49.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:49 smithi040 bash[35794]: cluster 2024-02-10T08:35:48.180641+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:49.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:49 smithi040 bash[38951]: cluster 2024-02-10T08:35:48.180641+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:49 smithi145 bash[35820]: cluster 2024-02-10T08:35:48.180641+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:50.149 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled grafana update... 2024-02-10T08:35:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:50 smithi145 bash[35820]: audit 2024-02-10T08:35:50.145573+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-10T08:35:50.145195\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-10T08:35:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:50 smithi145 bash[35820]: audit 2024-02-10T08:35:50.148745+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-10T08:35:50.145195\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-10T08:35:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:50 smithi040 bash[35794]: audit 2024-02-10T08:35:50.145573+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-10T08:35:50.145195\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-10T08:35:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:50 smithi040 bash[35794]: audit 2024-02-10T08:35:50.148745+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-10T08:35:50.145195\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-10T08:35:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:50 smithi040 bash[38951]: audit 2024-02-10T08:35:50.145573+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-10T08:35:50.145195\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-10T08:35:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:50 smithi040 bash[38951]: audit 2024-02-10T08:35:50.148745+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-10T08:35:50.145195\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi145\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-10T08:35:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:51 smithi145 bash[35820]: audit 2024-02-10T08:35:50.144592+0000 mgr.y (mgr.14140) 161 : audit [DBG] from='client.34337 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:51 smithi145 bash[35820]: cephadm 2024-02-10T08:35:50.145180+0000 mgr.y (mgr.14140) 162 : cephadm [INF] Saving service grafana spec with placement count:1 smithi145=a 2024-02-10T08:35:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:51 smithi145 bash[35820]: cluster 2024-02-10T08:35:50.181048+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:51 smithi145 bash[35820]: audit 2024-02-10T08:35:50.198173+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554137.2433784, \"finished_at\": 1707554147.10626}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:51 smithi145 bash[35820]: audit 2024-02-10T08:35:50.205564+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554137.2433784, \"finished_at\": 1707554147.10626}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[35794]: audit 2024-02-10T08:35:50.144592+0000 mgr.y (mgr.14140) 161 : audit [DBG] from='client.34337 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[35794]: cephadm 2024-02-10T08:35:50.145180+0000 mgr.y (mgr.14140) 162 : cephadm [INF] Saving service grafana spec with placement count:1 smithi145=a 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[35794]: cluster 2024-02-10T08:35:50.181048+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[35794]: audit 2024-02-10T08:35:50.198173+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554137.2433784, \"finished_at\": 1707554147.10626}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[35794]: audit 2024-02-10T08:35:50.205564+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554137.2433784, \"finished_at\": 1707554147.10626}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[38951]: audit 2024-02-10T08:35:50.144592+0000 mgr.y (mgr.14140) 161 : audit [DBG] from='client.34337 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi145=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[38951]: cephadm 2024-02-10T08:35:50.145180+0000 mgr.y (mgr.14140) 162 : cephadm [INF] Saving service grafana spec with placement count:1 smithi145=a 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[38951]: cluster 2024-02-10T08:35:50.181048+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[38951]: audit 2024-02-10T08:35:50.198173+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554137.2433784, \"finished_at\": 1707554147.10626}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T08:35:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:51 smithi040 bash[38951]: audit 2024-02-10T08:35:50.205564+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554079.097497, \"finished_at\": 1707554092.1635134}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554100.2559822, \"finished_at\": 1707554111.4692633}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554118.4248374, \"finished_at\": 1707554130.9006414}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554137.2433784, \"finished_at\": 1707554147.10626}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T08:35:52.112 DEBUG:teuthology.orchestra.run.smithi145:grafana.a> sudo journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@grafana.a.service 2024-02-10T08:35:52.115 INFO:tasks.cephadm:Setting up client nodes... 2024-02-10T08:35:52.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-10T08:35:52.145 INFO:journalctl@ceph.grafana.a.smithi145.stdout:-- Logs begin at Sat 2024-02-10 08:22:02 UTC. -- 2024-02-10T08:35:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:53 smithi145 bash[35820]: cluster 2024-02-10T08:35:52.181421+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:53 smithi040 bash[35794]: cluster 2024-02-10T08:35:52.181421+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:53 smithi040 bash[38951]: cluster 2024-02-10T08:35:52.181421+0000 mgr.y (mgr.14140) 164 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:54.471 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-02-10T08:35:54.471 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBqNcdlKTflGxAAtkkxsiC73mYMfkl0ALIREg== 2024-02-10T08:35:55.332 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-02-10T08:35:55.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-10T08:35:55.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-10T08:35:55.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-10T08:35:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:55 smithi145 bash[35820]: cluster 2024-02-10T08:35:54.181758+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:55 smithi145 bash[35820]: audit 2024-02-10T08:35:54.467588+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.40:0/2361054368' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:35:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:55 smithi145 bash[35820]: audit 2024-02-10T08:35:54.467893+0000 mon.a (mon.0) 463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:35:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:55 smithi145 bash[35820]: audit 2024-02-10T08:35:54.470947+0000 mon.a (mon.0) 464 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:35:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[35794]: cluster 2024-02-10T08:35:54.181758+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[35794]: audit 2024-02-10T08:35:54.467588+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.40:0/2361054368' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[35794]: audit 2024-02-10T08:35:54.467893+0000 mon.a (mon.0) 463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[35794]: audit 2024-02-10T08:35:54.470947+0000 mon.a (mon.0) 464 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[38951]: cluster 2024-02-10T08:35:54.181758+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[38951]: audit 2024-02-10T08:35:54.467588+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.40:0/2361054368' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[38951]: audit 2024-02-10T08:35:54.467893+0000 mon.a (mon.0) 463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:35:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:55 smithi040 bash[38951]: audit 2024-02-10T08:35:54.470947+0000 mon.a (mon.0) 464 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:35:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:57 smithi040 bash[35794]: cluster 2024-02-10T08:35:56.182233+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:57 smithi040 bash[38951]: cluster 2024-02-10T08:35:56.182233+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:57 smithi145 bash[35820]: cluster 2024-02-10T08:35:56.182233+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:59.517 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:35:59 smithi145 bash[35820]: cluster 2024-02-10T08:35:58.182570+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:35:59 smithi040 bash[35794]: cluster 2024-02-10T08:35:58.182570+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:35:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:35:59 smithi040 bash[38951]: cluster 2024-02-10T08:35:58.182570+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:00.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:35:59 smithi145 podman[44488]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a" found: no such container 2024-02-10T08:36:00.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:35:59 smithi145 systemd[1]: Started Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:00.253 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2024-02-10T08:36:00.253 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQBwNcdlzAq2DhAAbCaVShd6axTX8xgezg/qxw== 2024-02-10T08:36:00.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:00 smithi145 bash[35820]: audit 2024-02-10T08:35:59.845461+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:00.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:00 smithi145 bash[35820]: audit 2024-02-10T08:35:59.849114+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:00.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:00 smithi145 bash[35820]: audit 2024-02-10T08:35:59.849952+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:00 smithi040 bash[35794]: audit 2024-02-10T08:35:59.845461+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:00.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:00 smithi040 bash[35794]: audit 2024-02-10T08:35:59.849114+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:00.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:00 smithi040 bash[35794]: audit 2024-02-10T08:35:59.849952+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:00 smithi040 bash[38951]: audit 2024-02-10T08:35:59.845461+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:00 smithi040 bash[38951]: audit 2024-02-10T08:35:59.849114+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814579\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814655\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814689\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814719\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814748\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:35:33.814776\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:00 smithi040 bash[38951]: audit 2024-02-10T08:35:59.849952+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[35820]: cluster 2024-02-10T08:36:00.183002+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[35820]: audit 2024-02-10T08:36:00.238902+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.145:0/1178343386' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:36:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[35820]: audit 2024-02-10T08:36:00.246669+0000 mon.a (mon.0) 468 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:36:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[35820]: audit 2024-02-10T08:36:00.252783+0000 mon.a (mon.0) 469 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:36:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[35794]: cluster 2024-02-10T08:36:00.183002+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[35794]: audit 2024-02-10T08:36:00.238902+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.145:0/1178343386' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[35794]: audit 2024-02-10T08:36:00.246669+0000 mon.a (mon.0) 468 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[35794]: audit 2024-02-10T08:36:00.252783+0000 mon.a (mon.0) 469 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[38951]: cluster 2024-02-10T08:36:00.183002+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[38951]: audit 2024-02-10T08:36:00.238902+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.145:0/1178343386' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[38951]: audit 2024-02-10T08:36:00.246669+0000 mon.a (mon.0) 468 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-10T08:36:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:01 smithi040 bash[38951]: audit 2024-02-10T08:36:00.252783+0000 mon.a (mon.0) 469 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-10T08:36:01.789 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-02-10T08:36:01.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-10T08:36:01.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-10T08:36:01.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:36:02.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.909Z caller=main.go:544 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-10T08:36:02.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.909Z caller=main.go:588 level=info msg="Starting Prometheus Server" mode=server version="(version=2.49.1, branch=HEAD, revision=43e14844a33b65e2a396e3944272af8b3a494071)" 2024-02-10T08:36:02.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.909Z caller=main.go:593 level=info build_context="(go=go1.21.6, platform=linux/amd64, user=root@6d5f4c649d25, date=20240115-16:58:43, tags=netgo,builtinassets,stringlabels)" 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.909Z caller=main.go:594 level=info host_details="(Linux 4.18.0-536.el8.x86_64 #1 SMP Thu Jan 18 15:15:29 UTC 2024 x86_64 smithi145 (none))" 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.909Z caller=main.go:595 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.909Z caller=main.go:596 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.911Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.911Z caller=main.go:1039 level=info msg="Starting TSDB ..." 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.912Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.912Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.914Z caller=head.go:606 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.914Z caller=head.go:687 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=15.993µs 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.914Z caller=head.go:695 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.915Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.915Z caller=head.go:803 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=22.059µs wal_replay_duration=216.155µs wbl_replay_duration=128ns total_replay_duration=273.263µs 2024-02-10T08:36:02.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.916Z caller=main.go:1060 level=info fs_type=XFS_SUPER_MAGIC 2024-02-10T08:36:02.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.916Z caller=main.go:1063 level=info msg="TSDB started" 2024-02-10T08:36:02.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.916Z caller=main.go:1245 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-10T08:36:02.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.917Z caller=main.go:1282 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=586.236µs db_storage=775ns remote_storage=1.059µs web_handler=327ns query_engine=674ns scrape=376.794µs scrape_sd=21.815µs notify=600ns notify_sd=1.298µs rules=25.064µs tracing=5.225µs 2024-02-10T08:36:02.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.917Z caller=main.go:1024 level=info msg="Server is ready to receive web requests." 2024-02-10T08:36:02.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:36:01 smithi145 bash[44516]: ts=2024-02-10T08:36:01.917Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-10T08:36:03.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[35820]: cluster 2024-02-10T08:36:02.183322+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:03.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[35820]: audit 2024-02-10T08:36:02.918277+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_daemon_update\": \"2024-02-10T08:36:02.917502\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:03.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[35820]: audit 2024-02-10T08:36:02.921244+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_daemon_update\": \"2024-02-10T08:36:02.917502\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:03.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[35820]: audit 2024-02-10T08:36:02.922693+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-10T08:36:03.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[35820]: audit 2024-02-10T08:36:02.923351+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[35794]: cluster 2024-02-10T08:36:02.183322+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[38951]: cluster 2024-02-10T08:36:02.183322+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[38951]: audit 2024-02-10T08:36:02.918277+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_daemon_update\": \"2024-02-10T08:36:02.917502\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:03.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[38951]: audit 2024-02-10T08:36:02.921244+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_daemon_update\": \"2024-02-10T08:36:02.917502\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:03.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[38951]: audit 2024-02-10T08:36:02.922693+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-10T08:36:03.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[38951]: audit 2024-02-10T08:36:02.923351+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:03.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[35794]: audit 2024-02-10T08:36:02.918277+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_daemon_update\": \"2024-02-10T08:36:02.917502\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:03.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[35794]: audit 2024-02-10T08:36:02.921244+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}}, \"last_daemon_update\": \"2024-02-10T08:36:02.917502\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:03.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[35794]: audit 2024-02-10T08:36:02.922693+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-10T08:36:03.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:03 smithi040 bash[35794]: audit 2024-02-10T08:36:02.923351+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:03.783 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:03 smithi145 systemd[1]: Started Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:03.783 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[45006]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2024-02-10T08:36:03.783 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:03 smithi145 bash[45006]: Trying to pull docker.io/prom/node-exporter:latest... 2024-02-10T08:36:04.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:03 smithi040 systemd[1]: Starting Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:36:04.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:36:04.343 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"fsid":"a67cbc88-c7ee-11ee-95b8-87774f69a715","created":"2024-02-10T08:30:59.682599+0000","modified":"2024-02-10T08:35:38.240590+0000","last_up_change":"2024-02-10T08:35:37.239260+0000","last_in_change":"2024-02-10T08:35:37.239260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:31:11.192024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"066f4269-9cf7-4480-8575-a2fcf6a72404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6803","nonce":485086859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6805","nonce":485086859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6809","nonce":485086859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6807","nonce":485086859}]},"public_addr":"172.21.15.40:6803/485086859","cluster_addr":"172.21.15.40:6805/485086859","heartbeat_back_addr":"172.21.15.40:6809/485086859","heartbeat_front_addr":"172.21.15.40:6807/485086859","state":["exists","up"]},{"osd":1,"uuid":"09f46a8e-6338-4458-a3d6-28560e580b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6811","nonce":2032348490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6813","nonce":2032348490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6817","nonce":2032348490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6815","nonce":2032348490}]},"public_addr":"172.21.15.40:6811/2032348490","cluster_addr":"172.21.15.40:6813/2032348490","heartbeat_back_addr":"172.21.15.40:6817/2032348490","heartbeat_front_addr":"172.21.15.40:6815/2032348490","state":["exists","up"]},{"osd":2,"uuid":"f5397c1c-cc08-4591-9a75-867299f80a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6819","nonce":42000414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6821","nonce":42000414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6825","nonce":42000414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6823","nonce":42000414}]},"public_addr":"172.21.15.40:6819/42000414","cluster_addr":"172.21.15.40:6821/42000414","heartbeat_back_addr":"172.21.15.40:6825/42000414","heartbeat_front_addr":"172.21.15.40:6823/42000414","state":["exists","up"]},{"osd":3,"uuid":"98f5c8b5-a97a-4e49-a7eb-46639f974dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6827","nonce":1379176638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6829","nonce":1379176638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6833","nonce":1379176638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6831","nonce":1379176638}]},"public_addr":"172.21.15.40:6827/1379176638","cluster_addr":"172.21.15.40:6829/1379176638","heartbeat_back_addr":"172.21.15.40:6833/1379176638","heartbeat_front_addr":"172.21.15.40:6831/1379176638","state":["exists","up"]},{"osd":4,"uuid":"f1eac730-f5c7-46ec-a931-196ac88f2df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6801","nonce":4251252815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6803","nonce":4251252815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6807","nonce":4251252815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6805","nonce":4251252815}]},"public_addr":"172.21.15.145:6801/4251252815","cluster_addr":"172.21.15.145:6803/4251252815","heartbeat_back_addr":"172.21.15.145:6807/4251252815","heartbeat_front_addr":"172.21.15.145:6805/4251252815","state":["exists","up"]},{"osd":5,"uuid":"65bd977b-afd2-4a17-b201-37abf5a7dba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6809","nonce":1574967972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6811","nonce":1574967972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6815","nonce":1574967972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6813","nonce":1574967972}]},"public_addr":"172.21.15.145:6809/1574967972","cluster_addr":"172.21.15.145:6811/1574967972","heartbeat_back_addr":"172.21.15.145:6815/1574967972","heartbeat_front_addr":"172.21.15.145:6813/1574967972","state":["exists","up"]},{"osd":6,"uuid":"1b66a495-8002-4920-a6b2-c8a2ddf2f530","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6817","nonce":725324518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6819","nonce":725324518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6823","nonce":725324518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6821","nonce":725324518}]},"public_addr":"172.21.15.145:6817/725324518","cluster_addr":"172.21.15.145:6819/725324518","heartbeat_back_addr":"172.21.15.145:6823/725324518","heartbeat_front_addr":"172.21.15.145:6821/725324518","state":["exists","up"]},{"osd":7,"uuid":"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6825","nonce":464116144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6827","nonce":464116144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6831","nonce":464116144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6829","nonce":464116144}]},"public_addr":"172.21.15.145:6825/464116144","cluster_addr":"172.21.15.145:6827/464116144","heartbeat_back_addr":"172.21.15.145:6831/464116144","heartbeat_front_addr":"172.21.15.145:6829/464116144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:33:21.482332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:33:40.650321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:02.774210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:21.245615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:37.139635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:58.516031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:35:16.753089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:35:35.653797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.40:6801/4171225302":"2024-02-11T08:31:40.078958+0000","172.21.15.40:6800/4171225302":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1439866558":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1760596844":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1452386819":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/2925255174":"2024-02-11T08:31:17.976922+0000","172.21.15.40:6800/719461906":"2024-02-11T08:31:17.976922+0000","172.21.15.40:6801/719461906":"2024-02-11T08:31:17.976922+0000","172.21.15.40:0/459015756":"2024-02-11T08:31:17.976922+0000","172.21.15.40:0/4289777270":"2024-02-11T08:31:17.976922+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-10T08:36:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:04 smithi145 bash[35820]: cephadm 2024-02-10T08:36:02.923858+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Deploying daemon node-exporter.b on smithi145 2024-02-10T08:36:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:04 smithi145 bash[35820]: audit 2024-02-10T08:36:03.415143+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:04 smithi145 bash[35820]: audit 2024-02-10T08:36:03.421358+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:04.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:04 smithi145 bash[35820]: audit 2024-02-10T08:36:03.422053+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-10T08:36:04.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:04 smithi145 bash[35820]: audit 2024-02-10T08:36:03.422907+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:04.676 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:04 smithi040 podman[47192]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter.a" found: no such container 2024-02-10T08:36:04.676 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:04 smithi040 systemd[1]: Started Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:04.676 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[47239]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2024-02-10T08:36:04.676 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[47239]: Trying to pull docker.io/prom/node-exporter:latest... 2024-02-10T08:36:04.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[35794]: cephadm 2024-02-10T08:36:02.923858+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Deploying daemon node-exporter.b on smithi145 2024-02-10T08:36:04.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[38951]: cephadm 2024-02-10T08:36:02.923858+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Deploying daemon node-exporter.b on smithi145 2024-02-10T08:36:04.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[35794]: audit 2024-02-10T08:36:03.415143+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:04.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[35794]: audit 2024-02-10T08:36:03.421358+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:04.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[35794]: audit 2024-02-10T08:36:03.422053+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-10T08:36:04.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[35794]: audit 2024-02-10T08:36:03.422907+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:04.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[38951]: audit 2024-02-10T08:36:03.415143+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:04.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[38951]: audit 2024-02-10T08:36:03.421358+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:04.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[38951]: audit 2024-02-10T08:36:03.422053+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-10T08:36:04.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:04 smithi040 bash[38951]: audit 2024-02-10T08:36:03.422907+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:36:05.089 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-10T08:31:11.192024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-10T08:36:05.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-10T08:36:05.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[38951]: cephadm 2024-02-10T08:36:03.423565+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-10T08:36:05.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[38951]: cluster 2024-02-10T08:36:04.183592+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[35794]: cephadm 2024-02-10T08:36:03.423565+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-10T08:36:05.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[35794]: cluster 2024-02-10T08:36:04.183592+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:05.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[38951]: audit 2024-02-10T08:36:04.334459+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:05.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[38951]: audit 2024-02-10T08:36:04.340015+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:05.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[38951]: audit 2024-02-10T08:36:04.340412+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.40:0/2612976548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[35794]: audit 2024-02-10T08:36:04.334459+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[35794]: audit 2024-02-10T08:36:04.340015+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:05.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:05 smithi040 bash[35794]: audit 2024-02-10T08:36:04.340412+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.40:0/2612976548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:05 smithi145 bash[35820]: cephadm 2024-02-10T08:36:03.423565+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-10T08:36:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:05 smithi145 bash[35820]: cluster 2024-02-10T08:36:04.183592+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:05 smithi145 bash[35820]: audit 2024-02-10T08:36:04.334459+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:05 smithi145 bash[35820]: audit 2024-02-10T08:36:04.340015+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:05.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:05 smithi145 bash[35820]: audit 2024-02-10T08:36:04.340412+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.40:0/2612976548' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:06 smithi145 bash[35820]: cephadm 2024-02-10T08:36:04.343186+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-10T08:36:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:06 smithi145 bash[35820]: cluster 2024-02-10T08:36:06.184053+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:06.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:06 smithi040 bash[38951]: cephadm 2024-02-10T08:36:04.343186+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-10T08:36:06.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:06 smithi040 bash[38951]: cluster 2024-02-10T08:36:06.184053+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:06.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:06 smithi040 bash[35794]: cephadm 2024-02-10T08:36:04.343186+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-10T08:36:06.642 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:06 smithi040 bash[35794]: cluster 2024-02-10T08:36:06.184053+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:07.307 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-02-10T08:36:08.221 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-10T08:36:08.221 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-10T08:36:08.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph mgr dump --format=json 2024-02-10T08:36:08.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:08 smithi040 bash[35794]: audit 2024-02-10T08:36:07.307244+0000 mon.a (mon.0) 480 : audit [DBG] from='client.? 172.21.15.40:0/3264601784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-10T08:36:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:08 smithi040 bash[38951]: audit 2024-02-10T08:36:07.307244+0000 mon.a (mon.0) 480 : audit [DBG] from='client.? 172.21.15.40:0/3264601784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-10T08:36:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:08 smithi145 bash[35820]: audit 2024-02-10T08:36:07.307244+0000 mon.a (mon.0) 480 : audit [DBG] from='client.? 172.21.15.40:0/3264601784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-10T08:36:09.406 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:09 smithi040 bash[35794]: cluster 2024-02-10T08:36:08.184376+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:09.407 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:09 smithi040 bash[38951]: cluster 2024-02-10T08:36:08.184376+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:09 smithi145 bash[35820]: cluster 2024-02-10T08:36:08.184376+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:10.532 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:10 smithi145 bash[45006]: Getting image source signatures 2024-02-10T08:36:10.532 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:10 smithi145 bash[45006]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-02-10T08:36:10.532 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:10 smithi145 bash[45006]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-02-10T08:36:10.532 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:10 smithi145 bash[45006]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-02-10T08:36:10.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:36:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[35794]: cluster 2024-02-10T08:36:10.184855+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:11.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[35794]: audit 2024-02-10T08:36:10.608134+0000 mon.a (mon.0) 481 : audit [DBG] from='client.? 172.21.15.40:0/4238254160' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:36:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[38951]: cluster 2024-02-10T08:36:10.184855+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[38951]: audit 2024-02-10T08:36:10.608134+0000 mon.a (mon.0) 481 : audit [DBG] from='client.? 172.21.15.40:0/4238254160' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:36:11.426 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[47239]: Getting image source signatures 2024-02-10T08:36:11.427 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[47239]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-02-10T08:36:11.427 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[47239]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-02-10T08:36:11.427 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:11 smithi040 bash[47239]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-02-10T08:36:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:11 smithi145 bash[35820]: cluster 2024-02-10T08:36:10.184855+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:11 smithi145 bash[35820]: audit 2024-02-10T08:36:10.608134+0000 mon.a (mon.0) 481 : audit [DBG] from='client.? 172.21.15.40:0/4238254160' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:36:11.651 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3618379429},{"type":"v1","addr":"172.21.15.40:6801","nonce":3618379429}]},"active_addr":"172.21.15.40:6801/3618379429","active_change":"2024-02-10T08:31:40.079278+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi040.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":4029600788}]},{"addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":411434500}]},{"addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":135113010}]}]}} 2024-02-10T08:36:11.654 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-10T08:36:11.654 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-10T08:36:11.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:36:12.032 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:11 smithi145 bash[45006]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-02-10T08:36:12.032 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:11 smithi145 bash[45006]: Writing manifest to image destination 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.730Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.731Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.731Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.731Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.731Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.731Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-10T08:36:13.244 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=arp 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=edac 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-10T08:36:13.245 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-10T08:36:13.246 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=os 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=stat 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-10T08:36:13.247 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=time 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=uname 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-02-10T08:36:13.248 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:36:12 smithi145 bash[45006]: ts=2024-02-10T08:36:12.732Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-10T08:36:13.516 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:13 smithi040 bash[35794]: cluster 2024-02-10T08:36:12.185229+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:13.517 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:13 smithi040 bash[38951]: cluster 2024-02-10T08:36:12.185229+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:13.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:13 smithi145 bash[35820]: cluster 2024-02-10T08:36:12.185229+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:14.884 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:36:14.884 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"fsid":"a67cbc88-c7ee-11ee-95b8-87774f69a715","created":"2024-02-10T08:30:59.682599+0000","modified":"2024-02-10T08:35:38.240590+0000","last_up_change":"2024-02-10T08:35:37.239260+0000","last_in_change":"2024-02-10T08:35:37.239260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:31:11.192024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"066f4269-9cf7-4480-8575-a2fcf6a72404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6803","nonce":485086859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6805","nonce":485086859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6809","nonce":485086859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6807","nonce":485086859}]},"public_addr":"172.21.15.40:6803/485086859","cluster_addr":"172.21.15.40:6805/485086859","heartbeat_back_addr":"172.21.15.40:6809/485086859","heartbeat_front_addr":"172.21.15.40:6807/485086859","state":["exists","up"]},{"osd":1,"uuid":"09f46a8e-6338-4458-a3d6-28560e580b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6811","nonce":2032348490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6813","nonce":2032348490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6817","nonce":2032348490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6815","nonce":2032348490}]},"public_addr":"172.21.15.40:6811/2032348490","cluster_addr":"172.21.15.40:6813/2032348490","heartbeat_back_addr":"172.21.15.40:6817/2032348490","heartbeat_front_addr":"172.21.15.40:6815/2032348490","state":["exists","up"]},{"osd":2,"uuid":"f5397c1c-cc08-4591-9a75-867299f80a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6819","nonce":42000414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6821","nonce":42000414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6825","nonce":42000414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6823","nonce":42000414}]},"public_addr":"172.21.15.40:6819/42000414","cluster_addr":"172.21.15.40:6821/42000414","heartbeat_back_addr":"172.21.15.40:6825/42000414","heartbeat_front_addr":"172.21.15.40:6823/42000414","state":["exists","up"]},{"osd":3,"uuid":"98f5c8b5-a97a-4e49-a7eb-46639f974dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6827","nonce":1379176638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6829","nonce":1379176638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6833","nonce":1379176638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6831","nonce":1379176638}]},"public_addr":"172.21.15.40:6827/1379176638","cluster_addr":"172.21.15.40:6829/1379176638","heartbeat_back_addr":"172.21.15.40:6833/1379176638","heartbeat_front_addr":"172.21.15.40:6831/1379176638","state":["exists","up"]},{"osd":4,"uuid":"f1eac730-f5c7-46ec-a931-196ac88f2df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6801","nonce":4251252815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6803","nonce":4251252815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6807","nonce":4251252815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6805","nonce":4251252815}]},"public_addr":"172.21.15.145:6801/4251252815","cluster_addr":"172.21.15.145:6803/4251252815","heartbeat_back_addr":"172.21.15.145:6807/4251252815","heartbeat_front_addr":"172.21.15.145:6805/4251252815","state":["exists","up"]},{"osd":5,"uuid":"65bd977b-afd2-4a17-b201-37abf5a7dba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6809","nonce":1574967972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6811","nonce":1574967972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6815","nonce":1574967972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6813","nonce":1574967972}]},"public_addr":"172.21.15.145:6809/1574967972","cluster_addr":"172.21.15.145:6811/1574967972","heartbeat_back_addr":"172.21.15.145:6815/1574967972","heartbeat_front_addr":"172.21.15.145:6813/1574967972","state":["exists","up"]},{"osd":6,"uuid":"1b66a495-8002-4920-a6b2-c8a2ddf2f530","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6817","nonce":725324518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6819","nonce":725324518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6823","nonce":725324518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6821","nonce":725324518}]},"public_addr":"172.21.15.145:6817/725324518","cluster_addr":"172.21.15.145:6819/725324518","heartbeat_back_addr":"172.21.15.145:6823/725324518","heartbeat_front_addr":"172.21.15.145:6821/725324518","state":["exists","up"]},{"osd":7,"uuid":"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6825","nonce":464116144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6827","nonce":464116144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6831","nonce":464116144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6829","nonce":464116144}]},"public_addr":"172.21.15.145:6825/464116144","cluster_addr":"172.21.15.145:6827/464116144","heartbeat_back_addr":"172.21.15.145:6831/464116144","heartbeat_front_addr":"172.21.15.145:6829/464116144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:33:21.482332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:33:40.650321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:02.774210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:21.245615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:37.139635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:58.516031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:35:16.753089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:35:35.653797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.40:6801/4171225302":"2024-02-11T08:31:40.078958+0000","172.21.15.40:6800/4171225302":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1439866558":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1760596844":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1452386819":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/2925255174":"2024-02-11T08:31:17.976922+0000","172.21.15.40:6800/719461906":"2024-02-11T08:31:17.976922+0000","172.21.15.40:6801/719461906":"2024-02-11T08:31:17.976922+0000","172.21.15.40:0/459015756":"2024-02-11T08:31:17.976922+0000","172.21.15.40:0/4289777270":"2024-02-11T08:31:17.976922+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-10T08:36:15.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:14 smithi040 bash[47239]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-02-10T08:36:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:15 smithi145 bash[35820]: cluster 2024-02-10T08:36:14.185529+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:15 smithi145 bash[35820]: audit 2024-02-10T08:36:14.882947+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.40:0/619924486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:15.675 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:15 smithi040 bash[47239]: Writing manifest to image destination 2024-02-10T08:36:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:15 smithi040 bash[35794]: cluster 2024-02-10T08:36:14.185529+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:15 smithi040 bash[35794]: audit 2024-02-10T08:36:14.882947+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.40:0/619924486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:15 smithi040 bash[38951]: cluster 2024-02-10T08:36:14.185529+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:15 smithi040 bash[38951]: audit 2024-02-10T08:36:14.882947+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.40:0/619924486' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:17.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[35794]: cluster 2024-02-10T08:36:16.185861+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[38951]: cluster 2024-02-10T08:36:16.185861+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:17 smithi145 bash[35820]: cluster 2024-02-10T08:36:16.185861+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:17.719 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-10T08:36:17.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd dump --format=json 2024-02-10T08:36:17.925 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.482Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.482Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.483Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.483Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.483Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.483Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=arp 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-10T08:36:17.926 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=edac 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-10T08:36:17.927 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=os 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=stat 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-10T08:36:17.928 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=time 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=uname 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-02-10T08:36:17.929 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:36:17 smithi040 bash[47239]: ts=2024-02-10T08:36:17.484Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-10T08:36:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:19 smithi145 bash[35820]: cluster 2024-02-10T08:36:18.186206+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:19 smithi040 bash[35794]: cluster 2024-02-10T08:36:18.186206+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:19 smithi040 bash[38951]: cluster 2024-02-10T08:36:18.186206+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:21.518 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:21 smithi040 bash[35794]: cluster 2024-02-10T08:36:20.186584+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:21.518 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:21 smithi040 bash[38951]: cluster 2024-02-10T08:36:20.186584+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:21 smithi145 bash[35820]: cluster 2024-02-10T08:36:20.186584+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:21.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:36:21.975 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"fsid":"a67cbc88-c7ee-11ee-95b8-87774f69a715","created":"2024-02-10T08:30:59.682599+0000","modified":"2024-02-10T08:35:38.240590+0000","last_up_change":"2024-02-10T08:35:37.239260+0000","last_in_change":"2024-02-10T08:35:37.239260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-10T08:31:11.192024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"066f4269-9cf7-4480-8575-a2fcf6a72404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6803","nonce":485086859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6805","nonce":485086859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6809","nonce":485086859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":485086859},{"type":"v1","addr":"172.21.15.40:6807","nonce":485086859}]},"public_addr":"172.21.15.40:6803/485086859","cluster_addr":"172.21.15.40:6805/485086859","heartbeat_back_addr":"172.21.15.40:6809/485086859","heartbeat_front_addr":"172.21.15.40:6807/485086859","state":["exists","up"]},{"osd":1,"uuid":"09f46a8e-6338-4458-a3d6-28560e580b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6811","nonce":2032348490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6813","nonce":2032348490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6817","nonce":2032348490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2032348490},{"type":"v1","addr":"172.21.15.40:6815","nonce":2032348490}]},"public_addr":"172.21.15.40:6811/2032348490","cluster_addr":"172.21.15.40:6813/2032348490","heartbeat_back_addr":"172.21.15.40:6817/2032348490","heartbeat_front_addr":"172.21.15.40:6815/2032348490","state":["exists","up"]},{"osd":2,"uuid":"f5397c1c-cc08-4591-9a75-867299f80a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6819","nonce":42000414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6821","nonce":42000414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6825","nonce":42000414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":42000414},{"type":"v1","addr":"172.21.15.40:6823","nonce":42000414}]},"public_addr":"172.21.15.40:6819/42000414","cluster_addr":"172.21.15.40:6821/42000414","heartbeat_back_addr":"172.21.15.40:6825/42000414","heartbeat_front_addr":"172.21.15.40:6823/42000414","state":["exists","up"]},{"osd":3,"uuid":"98f5c8b5-a97a-4e49-a7eb-46639f974dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6827","nonce":1379176638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6829","nonce":1379176638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6833","nonce":1379176638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1379176638},{"type":"v1","addr":"172.21.15.40:6831","nonce":1379176638}]},"public_addr":"172.21.15.40:6827/1379176638","cluster_addr":"172.21.15.40:6829/1379176638","heartbeat_back_addr":"172.21.15.40:6833/1379176638","heartbeat_front_addr":"172.21.15.40:6831/1379176638","state":["exists","up"]},{"osd":4,"uuid":"f1eac730-f5c7-46ec-a931-196ac88f2df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6801","nonce":4251252815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6803","nonce":4251252815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6807","nonce":4251252815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":4251252815},{"type":"v1","addr":"172.21.15.145:6805","nonce":4251252815}]},"public_addr":"172.21.15.145:6801/4251252815","cluster_addr":"172.21.15.145:6803/4251252815","heartbeat_back_addr":"172.21.15.145:6807/4251252815","heartbeat_front_addr":"172.21.15.145:6805/4251252815","state":["exists","up"]},{"osd":5,"uuid":"65bd977b-afd2-4a17-b201-37abf5a7dba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6809","nonce":1574967972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6811","nonce":1574967972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6815","nonce":1574967972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1574967972},{"type":"v1","addr":"172.21.15.145:6813","nonce":1574967972}]},"public_addr":"172.21.15.145:6809/1574967972","cluster_addr":"172.21.15.145:6811/1574967972","heartbeat_back_addr":"172.21.15.145:6815/1574967972","heartbeat_front_addr":"172.21.15.145:6813/1574967972","state":["exists","up"]},{"osd":6,"uuid":"1b66a495-8002-4920-a6b2-c8a2ddf2f530","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6817","nonce":725324518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6819","nonce":725324518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6823","nonce":725324518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":725324518},{"type":"v1","addr":"172.21.15.145:6821","nonce":725324518}]},"public_addr":"172.21.15.145:6817/725324518","cluster_addr":"172.21.15.145:6819/725324518","heartbeat_back_addr":"172.21.15.145:6823/725324518","heartbeat_front_addr":"172.21.15.145:6821/725324518","state":["exists","up"]},{"osd":7,"uuid":"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6825","nonce":464116144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6827","nonce":464116144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6831","nonce":464116144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":464116144},{"type":"v1","addr":"172.21.15.145:6829","nonce":464116144}]},"public_addr":"172.21.15.145:6825/464116144","cluster_addr":"172.21.15.145:6827/464116144","heartbeat_back_addr":"172.21.15.145:6831/464116144","heartbeat_front_addr":"172.21.15.145:6829/464116144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:33:21.482332+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:33:40.650321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:02.774210+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:21.245615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:37.139635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:34:58.516031+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:35:16.753089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-10T08:35:35.653797+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.40:6801/4171225302":"2024-02-11T08:31:40.078958+0000","172.21.15.40:6800/4171225302":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1439866558":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1760596844":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/1452386819":"2024-02-11T08:31:40.078958+0000","172.21.15.40:0/2925255174":"2024-02-11T08:31:17.976922+0000","172.21.15.40:6800/719461906":"2024-02-11T08:31:17.976922+0000","172.21.15.40:6801/719461906":"2024-02-11T08:31:17.976922+0000","172.21.15.40:0/459015756":"2024-02-11T08:31:17.976922+0000","172.21.15.40:0/4289777270":"2024-02-11T08:31:17.976922+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-10T08:36:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:22 smithi145 bash[35820]: audit 2024-02-10T08:36:21.596703+0000 mon.a (mon.0) 482 : audit [DBG] from='client.? 172.21.15.40:0/775564700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:22.644 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:22 smithi040 bash[35794]: audit 2024-02-10T08:36:21.596703+0000 mon.a (mon.0) 482 : audit [DBG] from='client.? 172.21.15.40:0/775564700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:22.645 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:22 smithi040 bash[38951]: audit 2024-02-10T08:36:21.596703+0000 mon.a (mon.0) 482 : audit [DBG] from='client.? 172.21.15.40:0/775564700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-10T08:36:23.259 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:22 smithi040 systemd[1]: Starting Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:36:23.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-10T08:36:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:23 smithi145 bash[35820]: cluster 2024-02-10T08:36:22.186996+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:23.647 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[35794]: cluster 2024-02-10T08:36:22.186996+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:23.647 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[38951]: cluster 2024-02-10T08:36:22.186996+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:23.648 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 podman[48257]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a" found: no such container 2024-02-10T08:36:23.648 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 systemd[1]: Started Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.910Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.910Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.911Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.40 port=9094 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.912Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.938Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.938Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.940Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-10T08:36:24.263 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:23 smithi040 bash[48298]: ts=2024-02-10T08:36:23.940Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-10T08:36:24.264 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: audit 2024-02-10T08:36:23.340051+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:24.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: audit 2024-02-10T08:36:23.340051+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: audit 2024-02-10T08:36:23.342906+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: audit 2024-02-10T08:36:23.511323+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEH3hF/UrbEfgvZ1rvsb7oM8wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMTAwODM2MjNaFw0z\nNDAyMDcwODM2MjNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1I1PhRbSnwj4hM+Qvi7fH\nggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+nQgvw1eL\nVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDEwU7htg1o\nMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1KEiy6Ri+x\nNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaCMNpRdYYn\n8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9bzPBW6IUp\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAH2hJ/+cRvrOm1RkUVHRi6VrAyXwgtvn\nVel9l7iFm9697f4p35vsQdY6JGmzHGNMV2Ko8Oy+wAX1M3zSXnydSDDvfqvf78yP\nvzYolK6ICQ2gW2cYX6P4czNRLb208cXyx6gt0PMjvkzpk/Yy9d1Nr6sIds+WtTih\nRlw0rS2UoYWHAwC5qwX/YEpJszdhivaL9Zh00lJDONXweLpjr4GPzt3gDJUR/B9w\nqFg6XO9xew+iQPTJxM0V/m/rR0AeBx3AMse4BDaxyptBNWORmJadlQ2T/2F7+kj3\nNQAaCOdmmXVdC6nempRBje9DtV33W07sG1KRY3OD83MzxDCoU50JKHc=\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: audit 2024-02-10T08:36:23.513979+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEH3hF/UrbEfgvZ1rvsb7oM8wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMTAwODM2MjNaFw0z\nNDAyMDcwODM2MjNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1I1PhRbSnwj4hM+Qvi7fH\nggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+nQgvw1eL\nVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDEwU7htg1o\nMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1KEiy6Ri+x\nNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaCMNpRdYYn\n8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9bzPBW6IUp\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAH2hJ/+cRvrOm1RkUVHRi6VrAyXwgtvn\nVel9l7iFm9697f4p35vsQdY6JGmzHGNMV2Ko8Oy+wAX1M3zSXnydSDDvfqvf78yP\nvzYolK6ICQ2gW2cYX6P4czNRLb208cXyx6gt0PMjvkzpk/Yy9d1Nr6sIds+WtTih\nRlw0rS2UoYWHAwC5qwX/YEpJszdhivaL9Zh00lJDONXweLpjr4GPzt3gDJUR/B9w\nqFg6XO9xew+iQPTJxM0V/m/rR0AeBx3AMse4BDaxyptBNWORmJadlQ2T/2F7+kj3\nNQAaCOdmmXVdC6nempRBje9DtV33W07sG1KRY3OD83MzxDCoU50JKHc=\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: audit 2024-02-10T08:36:23.514391+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1I1PhRbSnwj4h\nM+Qvi7fHggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+\nnQgvw1eLVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDE\nwU7htg1oMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1K\nEiy6Ri+xNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaC\nMNpRdYYn8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9b\nzPBW6IUpAgMBAAECggEBAJTSircaQzxVziAPd1pNC9iiDWMq1uirSh5E/XF9L7vE\nJPL3zxcoxkTA2ueChCBYMfyuYo5eg/Uc6qmTcUd00jeMUr1lXqlzoXxYOsfc9TP6\navZNArkaDYo+U/P7qLikqrypp8QDnGaoQSEWxc2Set9yQ/LIca4g51KfbArgGTt6\nPPTTiPK4J5a3/zbGV2YHPGh9ZQBNCCZV0HKCGYS35JdcW3oxN39I5yzRdDoj1UxA\nQ6xpI385qpVyOcVJPh2tOHOq6e07ELgjZmiNmyc4cYFmvO33Iqod+y2ltr6G6zst\nH9ioopPf0qSBQBK+iICuEaITkHmrVKM68Ns5EpuauIECgYEA2pYchjpE2Pp/tIHb\nGtAnnaKjWXwRq+3FsirUU6xT6gV7bw6m1/qpGReL/xOBUDaoR6Z2sTI1RH6crC+4\nO+iebWOIUTHWCHwfi24UjTwI1REsGVbfxUW/aQh7tpkAZnNcM/BT1bPvnPKH9nqY\nUWtR0HGnz+r2uhzLw7JkBP4JlDECgYEA1CRTU6lrQhA051GaIA76s5UZLT55NM49\nZ2uy9TOJkJbYw4PeASLy8+JIbgfN1eh4lmy2sLkhlqZ+OTINIyhGvwkpHeKS97Bt\nYUrfG9kbiligkm/nOoE309VMEmdp28GC+EsG6l90VJGhfOM1mTlQNBO2vahOMXpZ\nvp+023H8mnkCgYEAyZRhnc+iqk7o8nhGrUWFIzRXXDC0w081YAdrY/aqNEj1+gcT\nCl6ZDxDOBF/igyzEp771+peI1C/HIGuphWYSpGKD1g0ViyGcnaLYxR62Lnf1qTCa\nkHyv9pbiMBSNb+22/BcH2S5lLOHlTQLl8T/9ZTNLRM0015GywDiFUK1N/CECgYEA\nq1ICsSe65QktkDnIXGd8cxbP1EgFnm2IDUNerMLIL6qCt7KA0S4mQmrVz3Yh9sPc\nzq5RA3se8wjWGt6e2WunZpPBTs8xnTIvw0ix0U2N/jYAxwH0HL1KFprE6n/1b3Fh\nkZ8VoKUhz0IkxjS/jlRIvyXEiHmpXC/Q1i8n4ai2NRECgYAnsnzon03w2j+12bZZ\n9sfkLWnPw/g9fLquc3DsE5O+jcbEyHmmtlI1OWgbn9rXfSvcEOfW/MLokgxfZs4M\nkubwSeCEr1+rkFqMdr3QcArekEx8cPJYhvGiJamf/mA9uxw9suFAsFvm7LsX3TV7\n35h722YUNPOsbqPH/O4i5UdAFw==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: audit 2024-02-10T08:36:23.518195+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1I1PhRbSnwj4h\nM+Qvi7fHggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+\nnQgvw1eLVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDE\nwU7htg1oMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1K\nEiy6Ri+xNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaC\nMNpRdYYn8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9b\nzPBW6IUpAgMBAAECggEBAJTSircaQzxVziAPd1pNC9iiDWMq1uirSh5E/XF9L7vE\nJPL3zxcoxkTA2ueChCBYMfyuYo5eg/Uc6qmTcUd00jeMUr1lXqlzoXxYOsfc9TP6\navZNArkaDYo+U/P7qLikqrypp8QDnGaoQSEWxc2Set9yQ/LIca4g51KfbArgGTt6\nPPTTiPK4J5a3/zbGV2YHPGh9ZQBNCCZV0HKCGYS35JdcW3oxN39I5yzRdDoj1UxA\nQ6xpI385qpVyOcVJPh2tOHOq6e07ELgjZmiNmyc4cYFmvO33Iqod+y2ltr6G6zst\nH9ioopPf0qSBQBK+iICuEaITkHmrVKM68Ns5EpuauIECgYEA2pYchjpE2Pp/tIHb\nGtAnnaKjWXwRq+3FsirUU6xT6gV7bw6m1/qpGReL/xOBUDaoR6Z2sTI1RH6crC+4\nO+iebWOIUTHWCHwfi24UjTwI1REsGVbfxUW/aQh7tpkAZnNcM/BT1bPvnPKH9nqY\nUWtR0HGnz+r2uhzLw7JkBP4JlDECgYEA1CRTU6lrQhA051GaIA76s5UZLT55NM49\nZ2uy9TOJkJbYw4PeASLy8+JIbgfN1eh4lmy2sLkhlqZ+OTINIyhGvwkpHeKS97Bt\nYUrfG9kbiligkm/nOoE309VMEmdp28GC+EsG6l90VJGhfOM1mTlQNBO2vahOMXpZ\nvp+023H8mnkCgYEAyZRhnc+iqk7o8nhGrUWFIzRXXDC0w081YAdrY/aqNEj1+gcT\nCl6ZDxDOBF/igyzEp771+peI1C/HIGuphWYSpGKD1g0ViyGcnaLYxR62Lnf1qTCa\nkHyv9pbiMBSNb+22/BcH2S5lLOHlTQLl8T/9ZTNLRM0015GywDiFUK1N/CECgYEA\nq1ICsSe65QktkDnIXGd8cxbP1EgFnm2IDUNerMLIL6qCt7KA0S4mQmrVz3Yh9sPc\nzq5RA3se8wjWGt6e2WunZpPBTs8xnTIvw0ix0U2N/jYAxwH0HL1KFprE6n/1b3Fh\nkZ8VoKUhz0IkxjS/jlRIvyXEiHmpXC/Q1i8n4ai2NRECgYAnsnzon03w2j+12bZZ\n9sfkLWnPw/g9fLquc3DsE5O+jcbEyHmmtlI1OWgbn9rXfSvcEOfW/MLokgxfZs4M\nkubwSeCEr1+rkFqMdr3QcArekEx8cPJYhvGiJamf/mA9uxw9suFAsFvm7LsX3TV7\n35h722YUNPOsbqPH/O4i5UdAFw==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: cephadm 2024-02-10T08:36:23.518616+0000 mgr.y (mgr.14140) 183 : cephadm [INF] Deploying daemon grafana.a on smithi145 2024-02-10T08:36:24.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:24 smithi145 bash[35820]: cluster 2024-02-10T08:36:24.187324+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: audit 2024-02-10T08:36:23.342906+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:24.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: audit 2024-02-10T08:36:23.340051+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: audit 2024-02-10T08:36:23.511323+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEH3hF/UrbEfgvZ1rvsb7oM8wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMTAwODM2MjNaFw0z\nNDAyMDcwODM2MjNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1I1PhRbSnwj4hM+Qvi7fH\nggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+nQgvw1eL\nVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDEwU7htg1o\nMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1KEiy6Ri+x\nNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaCMNpRdYYn\n8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9bzPBW6IUp\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAH2hJ/+cRvrOm1RkUVHRi6VrAyXwgtvn\nVel9l7iFm9697f4p35vsQdY6JGmzHGNMV2Ko8Oy+wAX1M3zSXnydSDDvfqvf78yP\nvzYolK6ICQ2gW2cYX6P4czNRLb208cXyx6gt0PMjvkzpk/Yy9d1Nr6sIds+WtTih\nRlw0rS2UoYWHAwC5qwX/YEpJszdhivaL9Zh00lJDONXweLpjr4GPzt3gDJUR/B9w\nqFg6XO9xew+iQPTJxM0V/m/rR0AeBx3AMse4BDaxyptBNWORmJadlQ2T/2F7+kj3\nNQAaCOdmmXVdC6nempRBje9DtV33W07sG1KRY3OD83MzxDCoU50JKHc=\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:36:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: audit 2024-02-10T08:36:23.513979+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEH3hF/UrbEfgvZ1rvsb7oM8wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMTAwODM2MjNaFw0z\nNDAyMDcwODM2MjNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1I1PhRbSnwj4hM+Qvi7fH\nggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+nQgvw1eL\nVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDEwU7htg1o\nMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1KEiy6Ri+x\nNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaCMNpRdYYn\n8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9bzPBW6IUp\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAH2hJ/+cRvrOm1RkUVHRi6VrAyXwgtvn\nVel9l7iFm9697f4p35vsQdY6JGmzHGNMV2Ko8Oy+wAX1M3zSXnydSDDvfqvf78yP\nvzYolK6ICQ2gW2cYX6P4czNRLb208cXyx6gt0PMjvkzpk/Yy9d1Nr6sIds+WtTih\nRlw0rS2UoYWHAwC5qwX/YEpJszdhivaL9Zh00lJDONXweLpjr4GPzt3gDJUR/B9w\nqFg6XO9xew+iQPTJxM0V/m/rR0AeBx3AMse4BDaxyptBNWORmJadlQ2T/2F7+kj3\nNQAaCOdmmXVdC6nempRBje9DtV33W07sG1KRY3OD83MzxDCoU50JKHc=\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:36:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: audit 2024-02-10T08:36:23.514391+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1I1PhRbSnwj4h\nM+Qvi7fHggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+\nnQgvw1eLVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDE\nwU7htg1oMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1K\nEiy6Ri+xNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaC\nMNpRdYYn8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9b\nzPBW6IUpAgMBAAECggEBAJTSircaQzxVziAPd1pNC9iiDWMq1uirSh5E/XF9L7vE\nJPL3zxcoxkTA2ueChCBYMfyuYo5eg/Uc6qmTcUd00jeMUr1lXqlzoXxYOsfc9TP6\navZNArkaDYo+U/P7qLikqrypp8QDnGaoQSEWxc2Set9yQ/LIca4g51KfbArgGTt6\nPPTTiPK4J5a3/zbGV2YHPGh9ZQBNCCZV0HKCGYS35JdcW3oxN39I5yzRdDoj1UxA\nQ6xpI385qpVyOcVJPh2tOHOq6e07ELgjZmiNmyc4cYFmvO33Iqod+y2ltr6G6zst\nH9ioopPf0qSBQBK+iICuEaITkHmrVKM68Ns5EpuauIECgYEA2pYchjpE2Pp/tIHb\nGtAnnaKjWXwRq+3FsirUU6xT6gV7bw6m1/qpGReL/xOBUDaoR6Z2sTI1RH6crC+4\nO+iebWOIUTHWCHwfi24UjTwI1REsGVbfxUW/aQh7tpkAZnNcM/BT1bPvnPKH9nqY\nUWtR0HGnz+r2uhzLw7JkBP4JlDECgYEA1CRTU6lrQhA051GaIA76s5UZLT55NM49\nZ2uy9TOJkJbYw4PeASLy8+JIbgfN1eh4lmy2sLkhlqZ+OTINIyhGvwkpHeKS97Bt\nYUrfG9kbiligkm/nOoE309VMEmdp28GC+EsG6l90VJGhfOM1mTlQNBO2vahOMXpZ\nvp+023H8mnkCgYEAyZRhnc+iqk7o8nhGrUWFIzRXXDC0w081YAdrY/aqNEj1+gcT\nCl6ZDxDOBF/igyzEp771+peI1C/HIGuphWYSpGKD1g0ViyGcnaLYxR62Lnf1qTCa\nkHyv9pbiMBSNb+22/BcH2S5lLOHlTQLl8T/9ZTNLRM0015GywDiFUK1N/CECgYEA\nq1ICsSe65QktkDnIXGd8cxbP1EgFnm2IDUNerMLIL6qCt7KA0S4mQmrVz3Yh9sPc\nzq5RA3se8wjWGt6e2WunZpPBTs8xnTIvw0ix0U2N/jYAxwH0HL1KFprE6n/1b3Fh\nkZ8VoKUhz0IkxjS/jlRIvyXEiHmpXC/Q1i8n4ai2NRECgYAnsnzon03w2j+12bZZ\n9sfkLWnPw/g9fLquc3DsE5O+jcbEyHmmtlI1OWgbn9rXfSvcEOfW/MLokgxfZs4M\nkubwSeCEr1+rkFqMdr3QcArekEx8cPJYhvGiJamf/mA9uxw9suFAsFvm7LsX3TV7\n35h722YUNPOsbqPH/O4i5UdAFw==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:36:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: audit 2024-02-10T08:36:23.518195+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1I1PhRbSnwj4h\nM+Qvi7fHggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+\nnQgvw1eLVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDE\nwU7htg1oMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1K\nEiy6Ri+xNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaC\nMNpRdYYn8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9b\nzPBW6IUpAgMBAAECggEBAJTSircaQzxVziAPd1pNC9iiDWMq1uirSh5E/XF9L7vE\nJPL3zxcoxkTA2ueChCBYMfyuYo5eg/Uc6qmTcUd00jeMUr1lXqlzoXxYOsfc9TP6\navZNArkaDYo+U/P7qLikqrypp8QDnGaoQSEWxc2Set9yQ/LIca4g51KfbArgGTt6\nPPTTiPK4J5a3/zbGV2YHPGh9ZQBNCCZV0HKCGYS35JdcW3oxN39I5yzRdDoj1UxA\nQ6xpI385qpVyOcVJPh2tOHOq6e07ELgjZmiNmyc4cYFmvO33Iqod+y2ltr6G6zst\nH9ioopPf0qSBQBK+iICuEaITkHmrVKM68Ns5EpuauIECgYEA2pYchjpE2Pp/tIHb\nGtAnnaKjWXwRq+3FsirUU6xT6gV7bw6m1/qpGReL/xOBUDaoR6Z2sTI1RH6crC+4\nO+iebWOIUTHWCHwfi24UjTwI1REsGVbfxUW/aQh7tpkAZnNcM/BT1bPvnPKH9nqY\nUWtR0HGnz+r2uhzLw7JkBP4JlDECgYEA1CRTU6lrQhA051GaIA76s5UZLT55NM49\nZ2uy9TOJkJbYw4PeASLy8+JIbgfN1eh4lmy2sLkhlqZ+OTINIyhGvwkpHeKS97Bt\nYUrfG9kbiligkm/nOoE309VMEmdp28GC+EsG6l90VJGhfOM1mTlQNBO2vahOMXpZ\nvp+023H8mnkCgYEAyZRhnc+iqk7o8nhGrUWFIzRXXDC0w081YAdrY/aqNEj1+gcT\nCl6ZDxDOBF/igyzEp771+peI1C/HIGuphWYSpGKD1g0ViyGcnaLYxR62Lnf1qTCa\nkHyv9pbiMBSNb+22/BcH2S5lLOHlTQLl8T/9ZTNLRM0015GywDiFUK1N/CECgYEA\nq1ICsSe65QktkDnIXGd8cxbP1EgFnm2IDUNerMLIL6qCt7KA0S4mQmrVz3Yh9sPc\nzq5RA3se8wjWGt6e2WunZpPBTs8xnTIvw0ix0U2N/jYAxwH0HL1KFprE6n/1b3Fh\nkZ8VoKUhz0IkxjS/jlRIvyXEiHmpXC/Q1i8n4ai2NRECgYAnsnzon03w2j+12bZZ\n9sfkLWnPw/g9fLquc3DsE5O+jcbEyHmmtlI1OWgbn9rXfSvcEOfW/MLokgxfZs4M\nkubwSeCEr1+rkFqMdr3QcArekEx8cPJYhvGiJamf/mA9uxw9suFAsFvm7LsX3TV7\n35h722YUNPOsbqPH/O4i5UdAFw==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:36:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: cephadm 2024-02-10T08:36:23.518616+0000 mgr.y (mgr.14140) 183 : cephadm [INF] Deploying daemon grafana.a on smithi145 2024-02-10T08:36:24.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[38951]: cluster 2024-02-10T08:36:24.187324+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: audit 2024-02-10T08:36:23.342906+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455448\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455524\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455557\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455586\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455615\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455643\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:34:19.455671\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: audit 2024-02-10T08:36:23.511323+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEH3hF/UrbEfgvZ1rvsb7oM8wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMTAwODM2MjNaFw0z\nNDAyMDcwODM2MjNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1I1PhRbSnwj4hM+Qvi7fH\nggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+nQgvw1eL\nVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDEwU7htg1o\nMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1KEiy6Ri+x\nNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaCMNpRdYYn\n8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9bzPBW6IUp\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAH2hJ/+cRvrOm1RkUVHRi6VrAyXwgtvn\nVel9l7iFm9697f4p35vsQdY6JGmzHGNMV2Ko8Oy+wAX1M3zSXnydSDDvfqvf78yP\nvzYolK6ICQ2gW2cYX6P4czNRLb208cXyx6gt0PMjvkzpk/Yy9d1Nr6sIds+WtTih\nRlw0rS2UoYWHAwC5qwX/YEpJszdhivaL9Zh00lJDONXweLpjr4GPzt3gDJUR/B9w\nqFg6XO9xew+iQPTJxM0V/m/rR0AeBx3AMse4BDaxyptBNWORmJadlQ2T/2F7+kj3\nNQAaCOdmmXVdC6nempRBje9DtV33W07sG1KRY3OD83MzxDCoU50JKHc=\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: audit 2024-02-10T08:36:23.513979+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEH3hF/UrbEfgvZ1rvsb7oM8wDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMTAwODM2MjNaFw0z\nNDAyMDcwODM2MjNaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1I1PhRbSnwj4hM+Qvi7fH\nggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+nQgvw1eL\nVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDEwU7htg1o\nMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1KEiy6Ri+x\nNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaCMNpRdYYn\n8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9bzPBW6IUp\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAH2hJ/+cRvrOm1RkUVHRi6VrAyXwgtvn\nVel9l7iFm9697f4p35vsQdY6JGmzHGNMV2Ko8Oy+wAX1M3zSXnydSDDvfqvf78yP\nvzYolK6ICQ2gW2cYX6P4czNRLb208cXyx6gt0PMjvkzpk/Yy9d1Nr6sIds+WtTih\nRlw0rS2UoYWHAwC5qwX/YEpJszdhivaL9Zh00lJDONXweLpjr4GPzt3gDJUR/B9w\nqFg6XO9xew+iQPTJxM0V/m/rR0AeBx3AMse4BDaxyptBNWORmJadlQ2T/2F7+kj3\nNQAaCOdmmXVdC6nempRBje9DtV33W07sG1KRY3OD83MzxDCoU50JKHc=\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: audit 2024-02-10T08:36:23.514391+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1I1PhRbSnwj4h\nM+Qvi7fHggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+\nnQgvw1eLVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDE\nwU7htg1oMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1K\nEiy6Ri+xNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaC\nMNpRdYYn8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9b\nzPBW6IUpAgMBAAECggEBAJTSircaQzxVziAPd1pNC9iiDWMq1uirSh5E/XF9L7vE\nJPL3zxcoxkTA2ueChCBYMfyuYo5eg/Uc6qmTcUd00jeMUr1lXqlzoXxYOsfc9TP6\navZNArkaDYo+U/P7qLikqrypp8QDnGaoQSEWxc2Set9yQ/LIca4g51KfbArgGTt6\nPPTTiPK4J5a3/zbGV2YHPGh9ZQBNCCZV0HKCGYS35JdcW3oxN39I5yzRdDoj1UxA\nQ6xpI385qpVyOcVJPh2tOHOq6e07ELgjZmiNmyc4cYFmvO33Iqod+y2ltr6G6zst\nH9ioopPf0qSBQBK+iICuEaITkHmrVKM68Ns5EpuauIECgYEA2pYchjpE2Pp/tIHb\nGtAnnaKjWXwRq+3FsirUU6xT6gV7bw6m1/qpGReL/xOBUDaoR6Z2sTI1RH6crC+4\nO+iebWOIUTHWCHwfi24UjTwI1REsGVbfxUW/aQh7tpkAZnNcM/BT1bPvnPKH9nqY\nUWtR0HGnz+r2uhzLw7JkBP4JlDECgYEA1CRTU6lrQhA051GaIA76s5UZLT55NM49\nZ2uy9TOJkJbYw4PeASLy8+JIbgfN1eh4lmy2sLkhlqZ+OTINIyhGvwkpHeKS97Bt\nYUrfG9kbiligkm/nOoE309VMEmdp28GC+EsG6l90VJGhfOM1mTlQNBO2vahOMXpZ\nvp+023H8mnkCgYEAyZRhnc+iqk7o8nhGrUWFIzRXXDC0w081YAdrY/aqNEj1+gcT\nCl6ZDxDOBF/igyzEp771+peI1C/HIGuphWYSpGKD1g0ViyGcnaLYxR62Lnf1qTCa\nkHyv9pbiMBSNb+22/BcH2S5lLOHlTQLl8T/9ZTNLRM0015GywDiFUK1N/CECgYEA\nq1ICsSe65QktkDnIXGd8cxbP1EgFnm2IDUNerMLIL6qCt7KA0S4mQmrVz3Yh9sPc\nzq5RA3se8wjWGt6e2WunZpPBTs8xnTIvw0ix0U2N/jYAxwH0HL1KFprE6n/1b3Fh\nkZ8VoKUhz0IkxjS/jlRIvyXEiHmpXC/Q1i8n4ai2NRECgYAnsnzon03w2j+12bZZ\n9sfkLWnPw/g9fLquc3DsE5O+jcbEyHmmtlI1OWgbn9rXfSvcEOfW/MLokgxfZs4M\nkubwSeCEr1+rkFqMdr3QcArekEx8cPJYhvGiJamf/mA9uxw9suFAsFvm7LsX3TV7\n35h722YUNPOsbqPH/O4i5UdAFw==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: audit 2024-02-10T08:36:23.518195+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQC1I1PhRbSnwj4h\nM+Qvi7fHggSxkWTwJSKwz7oyx6R9+L+KYUtH4/S1+Yq64flsjIghvSjA4Y8oWFq+\nnQgvw1eLVuNHBE2RJelDr9Y85we/1T5Wk8fex6/038VcYXMDy7ygjEtkvN2CGPDE\nwU7htg1oMqQPVHugVcHNBHofY56DmJMYmFuBNfUWQba+iCEluu9nhs8NDN/dua1K\nEiy6Ri+xNb174Ij1hcE6SIOo2PsOh1uCJM9VcGBuExJC0epTjaaPPEdz3SyE6BaC\nMNpRdYYn8pf0Osa2JJ/iWobE9vCWohfglgUFg6XsTS/32+GicZ6WbJ1Htilnpe9b\nzPBW6IUpAgMBAAECggEBAJTSircaQzxVziAPd1pNC9iiDWMq1uirSh5E/XF9L7vE\nJPL3zxcoxkTA2ueChCBYMfyuYo5eg/Uc6qmTcUd00jeMUr1lXqlzoXxYOsfc9TP6\navZNArkaDYo+U/P7qLikqrypp8QDnGaoQSEWxc2Set9yQ/LIca4g51KfbArgGTt6\nPPTTiPK4J5a3/zbGV2YHPGh9ZQBNCCZV0HKCGYS35JdcW3oxN39I5yzRdDoj1UxA\nQ6xpI385qpVyOcVJPh2tOHOq6e07ELgjZmiNmyc4cYFmvO33Iqod+y2ltr6G6zst\nH9ioopPf0qSBQBK+iICuEaITkHmrVKM68Ns5EpuauIECgYEA2pYchjpE2Pp/tIHb\nGtAnnaKjWXwRq+3FsirUU6xT6gV7bw6m1/qpGReL/xOBUDaoR6Z2sTI1RH6crC+4\nO+iebWOIUTHWCHwfi24UjTwI1REsGVbfxUW/aQh7tpkAZnNcM/BT1bPvnPKH9nqY\nUWtR0HGnz+r2uhzLw7JkBP4JlDECgYEA1CRTU6lrQhA051GaIA76s5UZLT55NM49\nZ2uy9TOJkJbYw4PeASLy8+JIbgfN1eh4lmy2sLkhlqZ+OTINIyhGvwkpHeKS97Bt\nYUrfG9kbiligkm/nOoE309VMEmdp28GC+EsG6l90VJGhfOM1mTlQNBO2vahOMXpZ\nvp+023H8mnkCgYEAyZRhnc+iqk7o8nhGrUWFIzRXXDC0w081YAdrY/aqNEj1+gcT\nCl6ZDxDOBF/igyzEp771+peI1C/HIGuphWYSpGKD1g0ViyGcnaLYxR62Lnf1qTCa\nkHyv9pbiMBSNb+22/BcH2S5lLOHlTQLl8T/9ZTNLRM0015GywDiFUK1N/CECgYEA\nq1ICsSe65QktkDnIXGd8cxbP1EgFnm2IDUNerMLIL6qCt7KA0S4mQmrVz3Yh9sPc\nzq5RA3se8wjWGt6e2WunZpPBTs8xnTIvw0ix0U2N/jYAxwH0HL1KFprE6n/1b3Fh\nkZ8VoKUhz0IkxjS/jlRIvyXEiHmpXC/Q1i8n4ai2NRECgYAnsnzon03w2j+12bZZ\n9sfkLWnPw/g9fLquc3DsE5O+jcbEyHmmtlI1OWgbn9rXfSvcEOfW/MLokgxfZs4M\nkubwSeCEr1+rkFqMdr3QcArekEx8cPJYhvGiJamf/mA9uxw9suFAsFvm7LsX3TV7\n35h722YUNPOsbqPH/O4i5UdAFw==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: cephadm 2024-02-10T08:36:23.518616+0000 mgr.y (mgr.14140) 183 : cephadm [INF] Deploying daemon grafana.a on smithi145 2024-02-10T08:36:24.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:24 smithi040 bash[35794]: cluster 2024-02-10T08:36:24.187324+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:26.175 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:25 smithi040 bash[48298]: ts=2024-02-10T08:36:25.913Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000509506s 2024-02-10T08:36:26.719 INFO:teuthology.orchestra.run.smithi040.stdout:42949673000 2024-02-10T08:36:26.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-10T08:36:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:27 smithi040 bash[35794]: cluster 2024-02-10T08:36:26.187723+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:27 smithi040 bash[38951]: cluster 2024-02-10T08:36:26.187723+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:27 smithi145 bash[35820]: cluster 2024-02-10T08:36:26.187723+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:29 smithi040 bash[35794]: cluster 2024-02-10T08:36:28.188035+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:29 smithi040 bash[38951]: cluster 2024-02-10T08:36:28.188035+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:68719476773 2024-02-10T08:36:29.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-10T08:36:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:29 smithi145 bash[35820]: cluster 2024-02-10T08:36:28.188035+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:31.318 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:31 smithi040 bash[35794]: cluster 2024-02-10T08:36:30.188564+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:31.319 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:31 smithi040 bash[38951]: cluster 2024-02-10T08:36:30.188564+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:31.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:31 smithi145 bash[35820]: cluster 2024-02-10T08:36:30.188564+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:90194313249 2024-02-10T08:36:32.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-10T08:36:33.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:33 smithi040 bash[35794]: cluster 2024-02-10T08:36:32.188999+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:33.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:33 smithi040 bash[38951]: cluster 2024-02-10T08:36:32.188999+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:33 smithi145 bash[35820]: cluster 2024-02-10T08:36:32.188999+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:34.131 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:33 smithi040 bash[48298]: ts=2024-02-10T08:36:33.914Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002324949s 2024-02-10T08:36:35.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:35 smithi040 bash[35794]: cluster 2024-02-10T08:36:34.189345+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:35.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:35 smithi040 bash[38951]: cluster 2024-02-10T08:36:34.189345+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:35.510 INFO:teuthology.orchestra.run.smithi040.stdout:111669149726 2024-02-10T08:36:35.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-10T08:36:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:35 smithi145 bash[35820]: cluster 2024-02-10T08:36:34.189345+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:37.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:37 smithi040 bash[35794]: cluster 2024-02-10T08:36:36.189651+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:37 smithi040 bash[38951]: cluster 2024-02-10T08:36:36.189651+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:37 smithi145 bash[35820]: cluster 2024-02-10T08:36:36.189651+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:38.532 INFO:teuthology.orchestra.run.smithi040.stdout:133143986201 2024-02-10T08:36:38.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-10T08:36:39.519 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:39 smithi040 bash[35794]: cluster 2024-02-10T08:36:38.190107+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:39.520 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:39 smithi040 bash[38951]: cluster 2024-02-10T08:36:38.190107+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:39 smithi145 bash[35820]: cluster 2024-02-10T08:36:38.190107+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:41.097 INFO:teuthology.orchestra.run.smithi040.stdout:154618822677 2024-02-10T08:36:41.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-10T08:36:41.211 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:40 smithi145 podman[45276]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana.a" found: no such container 2024-02-10T08:36:41.211 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:40 smithi145 systemd[1]: Started Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:41.395 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[38951]: cluster 2024-02-10T08:36:40.190540+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[35794]: cluster 2024-02-10T08:36:40.190540+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[35794]: audit 2024-02-10T08:36:40.888255+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[35794]: audit 2024-02-10T08:36:40.891025+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[35794]: audit 2024-02-10T08:36:40.891647+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[38951]: audit 2024-02-10T08:36:40.888255+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[38951]: audit 2024-02-10T08:36:40.891025+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:41.396 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:41 smithi040 bash[38951]: audit 2024-02-10T08:36:40.891647+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:41.520 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[35820]: cluster 2024-02-10T08:36:40.190540+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:41.520 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[35820]: audit 2024-02-10T08:36:40.888255+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:41.520 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[35820]: audit 2024-02-10T08:36:40.891025+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917182\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917265\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917299\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917331\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917361\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917391\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:02.917422\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:41.520 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[35820]: audit 2024-02-10T08:36:40.891647+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-10T08:36:41.521 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-10T08:36:41.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-10T08:36:41.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-10T08:36:41.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="App mode production" logger=settings 2024-02-10T08:36:41.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing SqlStore" logger=server 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Starting DB migration" logger=migrator 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-10T08:36:41.784 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-10T08:36:41.785 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-10T08:36:41.786 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-10T08:36:41.787 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-10T08:36:41.788 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-10T08:36:41.789 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-10T08:36:41.790 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-10T08:36:41.791 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-10T08:36:41.792 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-10T08:36:41.793 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-10T08:36:41.794 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-10T08:36:41.795 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-10T08:36:41.796 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-10T08:36:41.797 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-10T08:36:41.798 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-10T08:36:41.799 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-10T08:36:41.800 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-10T08:36:41.800 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-10T08:36:41.800 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-10T08:36:41.800 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-10T08:36:41.800 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing HTTPServer" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing PluginManager" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Starting plugin search" logger=plugins 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing HooksService" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing RemoteCache" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing QuotaService" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing ServerLockService" logger=server 2024-02-10T08:36:41.801 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing RenderingService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing AlertEngine" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing LoginService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing SearchService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing TracingService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing CleanUpService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing NotificationService" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="Initializing Stream Manager" 2024-02-10T08:36:41.802 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 08:36:41 smithi145 bash[45294]: t=2024-02-10T08:36:41+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2024-02-10T08:36:43.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:43 smithi040 bash[35794]: cluster 2024-02-10T08:36:42.190819+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:43.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:43 smithi040 bash[38951]: cluster 2024-02-10T08:36:42.190819+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:43.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:43 smithi145 bash[35820]: cluster 2024-02-10T08:36:42.190819+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:44.739 INFO:teuthology.orchestra.run.smithi040.stdout:176093659154 2024-02-10T08:36:44.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-10T08:36:45.469 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:45 smithi040 bash[38951]: cluster 2024-02-10T08:36:44.191100+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:45.469 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:45 smithi040 bash[35794]: cluster 2024-02-10T08:36:44.191100+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:45.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:45 smithi145 bash[35820]: cluster 2024-02-10T08:36:44.191100+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:47.124 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[35794]: cluster 2024-02-10T08:36:46.191463+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:47.124 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[35794]: audit 2024-02-10T08:36:46.702263+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"0b2c22ac594b\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701246\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:23.440976\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_daemon_update\": \"2024-02-10T08:36:46.701351\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:47.124 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[35794]: audit 2024-02-10T08:36:46.705427+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"0b2c22ac594b\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701246\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:23.440976\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_daemon_update\": \"2024-02-10T08:36:46.701351\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:47.124 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[35794]: audit 2024-02-10T08:36:46.706153+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[38951]: cluster 2024-02-10T08:36:46.191463+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[38951]: audit 2024-02-10T08:36:46.702263+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"0b2c22ac594b\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701246\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:23.440976\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_daemon_update\": \"2024-02-10T08:36:46.701351\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[38951]: audit 2024-02-10T08:36:46.705427+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"0b2c22ac594b\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701246\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:23.440976\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_daemon_update\": \"2024-02-10T08:36:46.701351\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:47 smithi040 bash[38951]: audit 2024-02-10T08:36:46.706153+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:47.521 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:47 smithi145 bash[35820]: cluster 2024-02-10T08:36:46.191463+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:47.522 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:47 smithi145 bash[35820]: audit 2024-02-10T08:36:46.702263+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"0b2c22ac594b\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701246\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:23.440976\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_daemon_update\": \"2024-02-10T08:36:46.701351\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:47.522 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:47 smithi145 bash[35820]: audit 2024-02-10T08:36:46.705427+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"0b2c22ac594b\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701246\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:23.440976\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:04.340649\"}}, \"last_daemon_update\": \"2024-02-10T08:36:46.701351\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:47.522 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:47 smithi145 bash[35820]: audit 2024-02-10T08:36:46.706153+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:36:49.360 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:49 smithi040 bash[35794]: cluster 2024-02-10T08:36:48.191877+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:49.360 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:49 smithi040 bash[38951]: cluster 2024-02-10T08:36:48.191877+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:49.374 INFO:teuthology.orchestra.run.smithi040.stdout:197568495633 2024-02-10T08:36:49.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-10T08:36:49.411 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:49 smithi145 bash[35820]: cluster 2024-02-10T08:36:48.191877+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:51 smithi145 bash[35820]: cluster 2024-02-10T08:36:50.192240+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:51 smithi145 bash[35820]: audit 2024-02-10T08:36:50.359090+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358170\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:36:50.358353\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:51 smithi145 bash[35820]: audit 2024-02-10T08:36:50.361902+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358170\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:36:50.358353\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:51.634 INFO:teuthology.orchestra.run.smithi040.stdout:42949673005 2024-02-10T08:36:51.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:51 smithi040 bash[38951]: cluster 2024-02-10T08:36:50.192240+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:51.660 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:51 smithi040 bash[35794]: cluster 2024-02-10T08:36:50.192240+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:51.661 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:51 smithi040 bash[38951]: audit 2024-02-10T08:36:50.359090+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358170\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:36:50.358353\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:51.661 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:51 smithi040 bash[38951]: audit 2024-02-10T08:36:50.361902+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358170\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:36:50.358353\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:51.661 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:51 smithi040 bash[35794]: audit 2024-02-10T08:36:50.359090+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358170\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:36:50.358353\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:36:51.661 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:51 smithi040 bash[35794]: audit 2024-02-10T08:36:50.361902+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"e63fab46754c\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358170\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:36:00.163825\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:35:40.974588\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:36:50.358353\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:36:52.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:52 smithi145 bash[35820]: cephadm 2024-02-10T08:36:50.363698+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:36:52.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:52 smithi145 bash[35820]: cephadm 2024-02-10T08:36:50.365605+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-10T08:36:52.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:52 smithi145 bash[35820]: audit 2024-02-10T08:36:51.634194+0000 mon.a (mon.0) 497 : audit [DBG] from='client.? 172.21.15.40:0/957468135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:36:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:52 smithi040 bash[35794]: cephadm 2024-02-10T08:36:50.363698+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:36:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:52 smithi040 bash[35794]: cephadm 2024-02-10T08:36:50.365605+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-10T08:36:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:52 smithi040 bash[35794]: audit 2024-02-10T08:36:51.634194+0000 mon.a (mon.0) 497 : audit [DBG] from='client.? 172.21.15.40:0/957468135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:36:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:52 smithi040 bash[38951]: cephadm 2024-02-10T08:36:50.363698+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:36:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:52 smithi040 bash[38951]: cephadm 2024-02-10T08:36:50.365605+0000 mgr.y (mgr.14140) 199 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-10T08:36:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:52 smithi040 bash[38951]: audit 2024-02-10T08:36:51.634194+0000 mon.a (mon.0) 497 : audit [DBG] from='client.? 172.21.15.40:0/957468135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-10T08:36:53.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:53 smithi040 bash[35794]: cluster 2024-02-10T08:36:52.192547+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:53 smithi040 bash[38951]: cluster 2024-02-10T08:36:52.192547+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:53 smithi145 bash[35820]: cluster 2024-02-10T08:36:52.192547+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:53.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673000 got 42949673005 for osd.0 2024-02-10T08:36:53.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-10T08:36:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:55 smithi145 bash[35820]: cluster 2024-02-10T08:36:54.192845+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:55.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:55 smithi040 bash[35794]: cluster 2024-02-10T08:36:54.192845+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:55 smithi040 bash[38951]: cluster 2024-02-10T08:36:54.192845+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:56.238 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:55 smithi040 systemd[1]: Stopping Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:36:56.607 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:56 smithi040 bash[48298]: ts=2024-02-10T08:36:56.237Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:36:57.156 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:57 smithi040 bash[35794]: cluster 2024-02-10T08:36:56.193237+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:57.156 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:57 smithi040 bash[38951]: cluster 2024-02-10T08:36:56.193237+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:57.427 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:57 smithi040 podman[50441]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a 2024-02-10T08:36:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:57 smithi145 bash[35820]: cluster 2024-02-10T08:36:56.193237+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:57.844 INFO:teuthology.orchestra.run.smithi040.stdout:68719476778 2024-02-10T08:36:57.877 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:57 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-10T08:36:57.877 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:57 smithi040 systemd[1]: Stopped Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:57.877 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:57 smithi040 systemd[1]: Starting Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:36:57.878 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:57 smithi040 podman[50521]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a" found: no such container 2024-02-10T08:36:57.878 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:57 smithi040 systemd[1]: Started Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:36:58.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[35794]: audit 2024-02-10T08:36:57.686220+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:58.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[35794]: audit 2024-02-10T08:36:57.690039+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:58.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[35794]: audit 2024-02-10T08:36:57.843688+0000 mon.a (mon.0) 500 : audit [DBG] from='client.? 172.21.15.40:0/3246787536' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:36:58.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[38951]: audit 2024-02-10T08:36:57.686220+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:58.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[38951]: audit 2024-02-10T08:36:57.690039+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:58.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[38951]: audit 2024-02-10T08:36:57.843688+0000 mon.a (mon.0) 500 : audit [DBG] from='client.? 172.21.15.40:0/3246787536' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:36:58.397 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:58 smithi145 bash[35820]: audit 2024-02-10T08:36:57.686220+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:36:58.398 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:58 smithi145 bash[35820]: audit 2024-02-10T08:36:57.690039+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700877\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.700994\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701032\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701081\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701121\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701153\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701184\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:46.701215\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:36:58.398 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:58 smithi145 bash[35820]: audit 2024-02-10T08:36:57.843688+0000 mon.a (mon.0) 500 : audit [DBG] from='client.? 172.21.15.40:0/3246787536' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-10T08:36:59.029 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.612Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-10T08:36:59.029 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.612Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-10T08:36:59.029 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.614Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.40 port=9094 2024-02-10T08:36:59.029 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.615Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-10T08:36:59.029 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.638Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:36:59.030 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.638Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:36:59.030 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.640Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-10T08:36:59.030 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:36:58 smithi040 bash[50547]: ts=2024-02-10T08:36:58.640Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-10T08:36:59.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476773 got 68719476778 for osd.1 2024-02-10T08:36:59.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-10T08:36:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:59 smithi145 bash[35820]: cephadm 2024-02-10T08:36:57.690651+0000 mgr.y (mgr.14140) 203 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-10T08:36:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:59 smithi145 bash[35820]: cephadm 2024-02-10T08:36:57.693683+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi145 2024-02-10T08:36:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:36:59 smithi145 bash[35820]: cluster 2024-02-10T08:36:58.193612+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:59.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:59 smithi040 bash[35794]: cephadm 2024-02-10T08:36:57.690651+0000 mgr.y (mgr.14140) 203 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-10T08:36:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:59 smithi040 bash[35794]: cephadm 2024-02-10T08:36:57.693683+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi145 2024-02-10T08:36:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:36:59 smithi040 bash[35794]: cluster 2024-02-10T08:36:58.193612+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:36:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:59 smithi040 bash[38951]: cephadm 2024-02-10T08:36:57.690651+0000 mgr.y (mgr.14140) 203 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-10T08:36:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:59 smithi040 bash[38951]: cephadm 2024-02-10T08:36:57.693683+0000 mgr.y (mgr.14140) 204 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi145 2024-02-10T08:36:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:36:59 smithi040 bash[38951]: cluster 2024-02-10T08:36:58.193612+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:00.734 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:37:00 smithi040 bash[50547]: ts=2024-02-10T08:37:00.615Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000701371s 2024-02-10T08:37:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:90194313254 2024-02-10T08:37:01.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:01 smithi040 bash[35794]: cluster 2024-02-10T08:37:00.194136+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:01.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:01 smithi040 bash[35794]: audit 2024-02-10T08:37:01.140773+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.40:0/2778892647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:37:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:01 smithi040 bash[38951]: cluster 2024-02-10T08:37:00.194136+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:01 smithi040 bash[38951]: audit 2024-02-10T08:37:01.140773+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.40:0/2778892647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:37:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[35820]: cluster 2024-02-10T08:37:00.194136+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[35820]: audit 2024-02-10T08:37:01.140773+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.40:0/2778892647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 systemd[1]: Stopping Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.298Z caller=main.go:874 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:898 level=info msg="Stopping scrape discovery manager..." 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:912 level=info msg="Stopping notify discovery manager..." 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:949 level=info msg="Stopping scrape manager..." 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:908 level=info msg="Notify discovery manager stopped" 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:894 level=info msg="Scrape discovery manager stopped" 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:941 level=info msg="Scrape manager stopped" 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:1171 level=info msg="Notifier manager stopped" 2024-02-10T08:37:01.533 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 bash[44516]: ts=2024-02-10T08:37:01.299Z caller=main.go:1183 level=info msg="See you next time!" 2024-02-10T08:37:01.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313249 got 90194313254 for osd.2 2024-02-10T08:37:01.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-10T08:37:02.016 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:01 smithi145 podman[45935]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a 2024-02-10T08:37:02.282 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service: Succeeded. 2024-02-10T08:37:02.282 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 systemd[1]: Stopped Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:37:02.282 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 systemd[1]: Starting Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:37:02.282 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 podman[45976]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a" found: no such container 2024-02-10T08:37:02.282 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 systemd[1]: Started Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:37:02.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[35820]: audit 2024-02-10T08:37:02.066455+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:02.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[35820]: audit 2024-02-10T08:37:02.069181+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:02.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[35820]: audit 2024-02-10T08:37:02.069792+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T08:37:02.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[35820]: audit 2024-02-10T08:37:02.075295+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi145:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-10T08:37:02.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[35820]: audit 2024-02-10T08:37:02.078031+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:02.580 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[35794]: audit 2024-02-10T08:37:02.066455+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:02.580 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[35794]: audit 2024-02-10T08:37:02.069181+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:02.580 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[35794]: audit 2024-02-10T08:37:02.069792+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T08:37:02.581 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[38951]: audit 2024-02-10T08:37:02.066455+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:02.581 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[38951]: audit 2024-02-10T08:37:02.069181+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.357924\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358006\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358040\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358081\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358113\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358142\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358200\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:36:50.358243\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:02.581 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[38951]: audit 2024-02-10T08:37:02.069792+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T08:37:02.581 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[35794]: audit 2024-02-10T08:37:02.075295+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi145:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-10T08:37:02.581 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[35794]: audit 2024-02-10T08:37:02.078031+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:02.581 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[38951]: audit 2024-02-10T08:37:02.075295+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi145:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-10T08:37:02.582 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:02 smithi040 bash[38951]: audit 2024-02-10T08:37:02.078031+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:03.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.601Z caller=main.go:544 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.601Z caller=main.go:588 level=info msg="Starting Prometheus Server" mode=server version="(version=2.49.1, branch=HEAD, revision=43e14844a33b65e2a396e3944272af8b3a494071)" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.601Z caller=main.go:593 level=info build_context="(go=go1.21.6, platform=linux/amd64, user=root@6d5f4c649d25, date=20240115-16:58:43, tags=netgo,builtinassets,stringlabels)" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.601Z caller=main.go:594 level=info host_details="(Linux 4.18.0-536.el8.x86_64 #1 SMP Thu Jan 18 15:15:29 UTC 2024 x86_64 smithi145 (none))" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.601Z caller=main.go:595 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.601Z caller=main.go:596 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.603Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.603Z caller=main.go:1039 level=info msg="Starting TSDB ..." 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.604Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.604Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.606Z caller=head.go:606 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.606Z caller=head.go:687 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.177µs 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.606Z caller=head.go:695 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.606Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-10T08:37:03.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.607Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.607Z caller=head.go:803 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=36.023µs wal_replay_duration=329.9µs wbl_replay_duration=117ns total_replay_duration=395.425µs 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.608Z caller=main.go:1060 level=info fs_type=XFS_SUPER_MAGIC 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.608Z caller=main.go:1063 level=info msg="TSDB started" 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.608Z caller=main.go:1245 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.609Z caller=main.go:1282 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=649.891µs db_storage=1.468µs remote_storage=1.406µs web_handler=402ns query_engine=687ns scrape=366.629µs scrape_sd=24.204µs notify=20.373µs notify_sd=6.478µs rules=25.037µs tracing=4.353µs 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.609Z caller=main.go:1024 level=info msg="Server is ready to receive web requests." 2024-02-10T08:37:03.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:37:02 smithi145 bash[45993]: ts=2024-02-10T08:37:02.609Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-10T08:37:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:03 smithi145 bash[35820]: cephadm 2024-02-10T08:37:02.069591+0000 mgr.y (mgr.14140) 207 : cephadm [INF] Setting dashboard grafana config to https://smithi145:3000 2024-02-10T08:37:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:03 smithi145 bash[35820]: cluster 2024-02-10T08:37:02.194460+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:03.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:03 smithi040 bash[35794]: cephadm 2024-02-10T08:37:02.069591+0000 mgr.y (mgr.14140) 207 : cephadm [INF] Setting dashboard grafana config to https://smithi145:3000 2024-02-10T08:37:03.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:03 smithi040 bash[35794]: cluster 2024-02-10T08:37:02.194460+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:03.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:03 smithi040 bash[38951]: cephadm 2024-02-10T08:37:02.069591+0000 mgr.y (mgr.14140) 207 : cephadm [INF] Setting dashboard grafana config to https://smithi145:3000 2024-02-10T08:37:03.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:03 smithi040 bash[38951]: cluster 2024-02-10T08:37:02.194460+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:04.956 INFO:teuthology.orchestra.run.smithi040.stdout:111669149731 2024-02-10T08:37:05.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:05 smithi040 bash[35794]: cluster 2024-02-10T08:37:04.194832+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:05.259 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:05 smithi040 bash[35794]: audit 2024-02-10T08:37:04.956509+0000 mon.a (mon.0) 506 : audit [DBG] from='client.? 172.21.15.40:0/2375950258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:37:05.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:05 smithi145 bash[35820]: cluster 2024-02-10T08:37:04.194832+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:05.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:05 smithi145 bash[35820]: audit 2024-02-10T08:37:04.956509+0000 mon.a (mon.0) 506 : audit [DBG] from='client.? 172.21.15.40:0/2375950258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:37:05.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:05 smithi040 bash[38951]: cluster 2024-02-10T08:37:04.194832+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:05.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:05 smithi040 bash[38951]: audit 2024-02-10T08:37:04.956509+0000 mon.a (mon.0) 506 : audit [DBG] from='client.? 172.21.15.40:0/2375950258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-10T08:37:06.093 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149726 got 111669149731 for osd.3 2024-02-10T08:37:06.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-10T08:37:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:07 smithi040 bash[35794]: cluster 2024-02-10T08:37:06.195156+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:07 smithi040 bash[38951]: cluster 2024-02-10T08:37:06.195156+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:07 smithi145 bash[35820]: cluster 2024-02-10T08:37:06.195156+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:08.374 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[35794]: audit 2024-02-10T08:37:07.836184+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.834918\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835007\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835044\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835087\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835119\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835149\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835181\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835213\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835245\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:07.835332\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:08.375 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[38951]: audit 2024-02-10T08:37:07.836184+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.834918\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835007\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835044\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835087\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835119\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835149\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835181\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835213\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835245\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:07.835332\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:08.375 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[35794]: audit 2024-02-10T08:37:07.840152+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.834918\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835007\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835044\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835087\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835119\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835149\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835181\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835213\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835245\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:07.835332\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:08.375 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[35794]: audit 2024-02-10T08:37:07.840792+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:08.375 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[38951]: audit 2024-02-10T08:37:07.840152+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.834918\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835007\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835044\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835087\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835119\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835149\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835181\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835213\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835245\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:07.835332\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:08.376 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[38951]: audit 2024-02-10T08:37:07.840792+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:08.434 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:08 smithi145 bash[35820]: audit 2024-02-10T08:37:07.836184+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.834918\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835007\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835044\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835087\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835119\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835149\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835181\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835213\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835245\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:07.835332\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:08.434 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:08 smithi145 bash[35820]: audit 2024-02-10T08:37:07.840152+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.834918\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835007\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835044\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835087\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835119\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835149\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835181\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835213\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:07.835245\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:07.835332\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:08.434 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:08 smithi145 bash[35820]: audit 2024-02-10T08:37:07.840792+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:08.631 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:37:08 smithi040 bash[50547]: ts=2024-02-10T08:37:08.618Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00318507s 2024-02-10T08:37:09.009 INFO:teuthology.orchestra.run.smithi040.stdout:133143986207 2024-02-10T08:37:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:09 smithi040 bash[35794]: cluster 2024-02-10T08:37:08.195584+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:09 smithi040 bash[35794]: audit 2024-02-10T08:37:09.009011+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.40:0/3385761692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:37:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:09 smithi040 bash[38951]: cluster 2024-02-10T08:37:08.195584+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:09 smithi040 bash[38951]: audit 2024-02-10T08:37:09.009011+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.40:0/3385761692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:37:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:09 smithi145 bash[35820]: cluster 2024-02-10T08:37:08.195584+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:09 smithi145 bash[35820]: audit 2024-02-10T08:37:09.009011+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.40:0/3385761692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-10T08:37:09.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986201 got 133143986207 for osd.4 2024-02-10T08:37:09.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-10T08:37:11.380 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:11 smithi040 bash[38951]: cluster 2024-02-10T08:37:10.195975+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:11.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:11 smithi040 bash[35794]: cluster 2024-02-10T08:37:10.195975+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:11 smithi145 bash[35820]: cluster 2024-02-10T08:37:10.195975+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:12.052 INFO:teuthology.orchestra.run.smithi040.stdout:154618822683 2024-02-10T08:37:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:12 smithi040 bash[35794]: audit 2024-02-10T08:37:12.051960+0000 mon.a (mon.0) 510 : audit [DBG] from='client.? 172.21.15.40:0/2686838797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:37:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:12 smithi040 bash[38951]: audit 2024-02-10T08:37:12.051960+0000 mon.a (mon.0) 510 : audit [DBG] from='client.? 172.21.15.40:0/2686838797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:37:12.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:12 smithi145 bash[35820]: audit 2024-02-10T08:37:12.051960+0000 mon.a (mon.0) 510 : audit [DBG] from='client.? 172.21.15.40:0/2686838797' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-10T08:37:12.776 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822677 got 154618822683 for osd.5 2024-02-10T08:37:12.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-10T08:37:13.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:13 smithi040 bash[35794]: cluster 2024-02-10T08:37:12.196439+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:13.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:13 smithi040 bash[38951]: cluster 2024-02-10T08:37:12.196439+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:13.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:13 smithi145 bash[35820]: cluster 2024-02-10T08:37:12.196439+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:14.843 INFO:teuthology.orchestra.run.smithi040.stdout:176093659160 2024-02-10T08:37:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:15 smithi145 bash[35820]: cluster 2024-02-10T08:37:14.196834+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:15.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:15 smithi145 bash[35820]: audit 2024-02-10T08:37:14.843001+0000 mon.a (mon.0) 511 : audit [DBG] from='client.? 172.21.15.40:0/4275223192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:37:15.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:15 smithi145 bash[35820]: audit 2024-02-10T08:37:15.073584+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072467\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072543\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072576\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072607\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072635\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072663\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072691\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072720\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072747\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:15.072826\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:15.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:15 smithi145 bash[35820]: audit 2024-02-10T08:37:15.076288+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072467\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072543\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072576\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072607\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072635\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072663\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072691\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072720\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072747\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:15.072826\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:15.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:15 smithi145 bash[35820]: audit 2024-02-10T08:37:15.078558+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:15.627 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[35794]: cluster 2024-02-10T08:37:14.196834+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:15.627 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[35794]: audit 2024-02-10T08:37:14.843001+0000 mon.a (mon.0) 511 : audit [DBG] from='client.? 172.21.15.40:0/4275223192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:37:15.627 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[38951]: cluster 2024-02-10T08:37:14.196834+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:15.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[38951]: audit 2024-02-10T08:37:14.843001+0000 mon.a (mon.0) 511 : audit [DBG] from='client.? 172.21.15.40:0/4275223192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-10T08:37:15.628 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[35794]: audit 2024-02-10T08:37:15.073584+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072467\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072543\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072576\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072607\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072635\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072663\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072691\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072720\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072747\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:15.072826\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:15.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[38951]: audit 2024-02-10T08:37:15.073584+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072467\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072543\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072576\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072607\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072635\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072663\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072691\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072720\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072747\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:15.072826\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:15.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[35794]: audit 2024-02-10T08:37:15.076288+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072467\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072543\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072576\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072607\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072635\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072663\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072691\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072720\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072747\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:15.072826\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:15.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[35794]: audit 2024-02-10T08:37:15.078558+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:15.629 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[38951]: audit 2024-02-10T08:37:15.076288+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072467\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072543\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072576\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072607\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072635\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072663\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072691\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072720\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:15.072747\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:15.072826\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:15.629 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:15 smithi040 bash[38951]: audit 2024-02-10T08:37:15.078558+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:15.638 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659154 got 176093659160 for osd.6 2024-02-10T08:37:15.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-10T08:37:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:17 smithi040 bash[35794]: cluster 2024-02-10T08:37:16.197204+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:17 smithi040 bash[38951]: cluster 2024-02-10T08:37:16.197204+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:17 smithi145 bash[35820]: cluster 2024-02-10T08:37:16.197204+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:18.219 INFO:teuthology.orchestra.run.smithi040.stdout:197568495638 2024-02-10T08:37:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:18 smithi145 bash[35820]: cluster 2024-02-10T08:37:18.197479+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:18 smithi145 bash[35820]: audit 2024-02-10T08:37:18.219478+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.40:0/1281646371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:37:18.588 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:18 smithi040 bash[35794]: cluster 2024-02-10T08:37:18.197479+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:18.588 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:18 smithi040 bash[35794]: audit 2024-02-10T08:37:18.219478+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.40:0/1281646371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:37:18.588 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:18 smithi040 bash[38951]: cluster 2024-02-10T08:37:18.197479+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:18.588 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:18 smithi040 bash[38951]: audit 2024-02-10T08:37:18.219478+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.40:0/1281646371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-10T08:37:19.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495633 got 197568495638 for osd.7 2024-02-10T08:37:19.062 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-10T08:37:19.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:37:21.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:21 smithi040 bash[35794]: cluster 2024-02-10T08:37:20.197767+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:21.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:21 smithi040 bash[38951]: cluster 2024-02-10T08:37:20.197767+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:21 smithi145 bash[35820]: cluster 2024-02-10T08:37:20.197767+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:22.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:37:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-02-10T08:37:23.256 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-02-10T08:37:20.197630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392224,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741568992,"statfs":{"total":767960285184,"available":759366647808,"internally_reserved":8589934592,"allocated":3637248,"data_stored":1443936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002269"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"47","state":"active+clean","last_fresh":"2024-02-10T08:35:38.249750+0000","last_change":"2024-02-10T08:35:38.249750+0000","last_active":"2024-02-10T08:35:38.249750+0000","last_peered":"2024-02-10T08:35:38.249750+0000","last_clean":"2024-02-10T08:35:38.249750+0000","last_became_active":"2024-02-10T08:35:38.247359+0000","last_became_peered":"2024-02-10T08:35:38.247359+0000","last_unstale":"2024-02-10T08:35:38.249750+0000","last_undegraded":"2024-02-10T08:35:38.249750+0000","last_fullsized":"2024-02-10T08:35:38.249750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:31:11.192050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:31:11.192050+0000","last_clean_scrub_stamp":"2024-02-10T08:31:11.192050+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495639,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.621}]},{"osd":1,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.40400000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.436}]},{"osd":6,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.47099999999999997}]}]},{"osd":6,"up_from":41,"seq":176093659162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.496},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.378}]},{"osd":5,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.436},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.45400000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.316,"15min":0.29699999999999999},"min":{"1min":0.249,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:37:10 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35599999999999998,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47299999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35199999999999998,"15min":0.34599999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.41999999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:36:27 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64200000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47199999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51700000000000002}]}]},{"osd":0,"up_from":10,"seq":42949673011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.308,"15min":0.29199999999999998},"min":{"1min":0.20599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.247},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.308},"min":{"1min":0.23599999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:37:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.35899999999999999,"15min":0.36699999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.436,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.436,"5min":0.62,"15min":0.62},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.315}]},{"osd":4,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.65400000000000003}]}]},{"osd":2,"up_from":21,"seq":90194313258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:08 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.48099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48699999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.307}]},{"osd":1,"last update":"Sat Feb 10 08:37:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38400000000000001},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.497,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.432},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45800000000000002}]},{"osd":5,"last update":"Sat Feb 10 08:37:06 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.54900000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149735,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.313},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61299999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.39200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:36:48 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.80200000000000005,"15min":0.83499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":7.4939999999999998,"15min":7.4939999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.7679999999999998,"5min":4.7679999999999998,"15min":4.7679999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55500000000000005}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.495}]},{"osd":3,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47999999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:37:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.34499999999999997},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.434}]},{"osd":6,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.378},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.32600000000000001}]}]},{"osd":5,"up_from":36,"seq":154618822685,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.503},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.503},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60699999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.57699999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63800000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.621,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.627,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.435},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.25800000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42099999999999999,"15min":0.42799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":1.103,"15min":1.103},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.312},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35699999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.33300000000000002}]}]}]}} 2024-02-10T08:37:23.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph pg dump --format=json 2024-02-10T08:37:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:23 smithi145 bash[35820]: audit 2024-02-10T08:37:22.077890+0000 mgr.y (mgr.14140) 218 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:23.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:23 smithi145 bash[35820]: cluster 2024-02-10T08:37:22.198154+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:23.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:23 smithi145 bash[35820]: audit 2024-02-10T08:37:22.390711+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:22.389926\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:23.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:23 smithi145 bash[35820]: audit 2024-02-10T08:37:22.393897+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:22.389926\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:23.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:23 smithi145 bash[35820]: audit 2024-02-10T08:37:22.394618+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:23.581 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[38951]: audit 2024-02-10T08:37:22.077890+0000 mgr.y (mgr.14140) 218 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:23.581 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[38951]: cluster 2024-02-10T08:37:22.198154+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[35794]: audit 2024-02-10T08:37:22.077890+0000 mgr.y (mgr.14140) 218 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[35794]: cluster 2024-02-10T08:37:22.198154+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[35794]: audit 2024-02-10T08:37:22.390711+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:22.389926\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[35794]: audit 2024-02-10T08:37:22.393897+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:22.389926\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[35794]: audit 2024-02-10T08:37:22.394618+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[38951]: audit 2024-02-10T08:37:22.390711+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:22.389926\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:23.582 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[38951]: audit 2024-02-10T08:37:22.393897+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}}, \"last_daemon_update\": \"2024-02-10T08:37:22.389926\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:23.583 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:23 smithi040 bash[38951]: audit 2024-02-10T08:37:22.394618+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:37:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:25 smithi040 bash[35794]: cluster 2024-02-10T08:37:24.198423+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:25 smithi040 bash[38951]: cluster 2024-02-10T08:37:24.198423+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:25.428 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:37:25.429 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-02-10T08:37:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:25 smithi145 bash[35820]: cluster 2024-02-10T08:37:24.198423+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:26.302 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-02-10T08:37:24.198302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392224,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741568992,"statfs":{"total":767960285184,"available":759366647808,"internally_reserved":8589934592,"allocated":3637248,"data_stored":1443936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002094"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"47","state":"active+clean","last_fresh":"2024-02-10T08:35:38.249750+0000","last_change":"2024-02-10T08:35:38.249750+0000","last_active":"2024-02-10T08:35:38.249750+0000","last_peered":"2024-02-10T08:35:38.249750+0000","last_clean":"2024-02-10T08:35:38.249750+0000","last_became_active":"2024-02-10T08:35:38.247359+0000","last_became_peered":"2024-02-10T08:35:38.247359+0000","last_unstale":"2024-02-10T08:35:38.249750+0000","last_undegraded":"2024-02-10T08:35:38.249750+0000","last_fullsized":"2024-02-10T08:35:38.249750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-10T08:31:11.192050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-10T08:31:11.192050+0000","last_clean_scrub_stamp":"2024-02-10T08:31:11.192050+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495640,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.435}]},{"osd":1,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.496},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.63400000000000001}]}]},{"osd":6,"up_from":41,"seq":176093659162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.496},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.378}]},{"osd":5,"last update":"Sat Feb 10 08:36:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Feb 10 08:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.436},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.45400000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.316,"15min":0.29699999999999999},"min":{"1min":0.249,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.30299999999999999},"min":{"1min":0.22700000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:37:10 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35599999999999998,"15min":0.34200000000000003},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47299999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35199999999999998,"15min":0.34599999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.41999999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:36:27 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.64200000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47199999999999998}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.501},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51700000000000002}]}]},{"osd":0,"up_from":10,"seq":42949673011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 10 08:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.308,"15min":0.29199999999999998},"min":{"1min":0.20599999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.55400000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.247},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.308},"min":{"1min":0.23599999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:37:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.35899999999999999,"15min":0.36699999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.436,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.436,"5min":0.62,"15min":0.62},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Feb 10 08:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39600000000000002,"15min":0.39800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.315}]},{"osd":4,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Feb 10 08:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.65400000000000003}]}]},{"osd":2,"up_from":21,"seq":90194313259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:08 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.48099999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48699999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:37:08 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38300000000000001,"15min":0.38400000000000001},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.45700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.371,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.497,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.61699999999999999}]},{"osd":3,"last update":"Sat Feb 10 08:36:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.42599999999999999,"15min":0.432},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.66000000000000003}]},{"osd":4,"last update":"Sat Feb 10 08:36:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.876}]},{"osd":5,"last update":"Sat Feb 10 08:37:06 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":1.01},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Feb 10 08:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.98099999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149735,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.313},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61299999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34599999999999997}]},{"osd":1,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.39200000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36499999999999999}]},{"osd":2,"last update":"Sat Feb 10 08:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Feb 10 08:36:48 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.80200000000000005,"15min":0.83499999999999996},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92900000000000005,"5min":7.5650000000000004,"15min":7.5650000000000004},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.80400000000000005,"5min":7.4939999999999998,"15min":7.4939999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Feb 10 08:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.7679999999999998,"5min":4.7679999999999998,"15min":4.7679999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55500000000000005}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.501,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48999999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46700000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39600000000000002}]},{"osd":2,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.39000000000000001}]},{"osd":3,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.48799999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41099999999999998}]},{"osd":5,"last update":"Sat Feb 10 08:37:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.35699999999999998,"15min":0.34499999999999997},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.28399999999999997}]},{"osd":6,"last update":"Sat Feb 10 08:37:22 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":1.575,"15min":1.575},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.39200000000000002,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.375}]},{"osd":7,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.33200000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822686,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.503},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.503},"min":{"1min":0.372,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60699999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.57699999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.501},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63800000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.621,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.496,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63400000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.57599999999999996}]},{"osd":3,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.627,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.627},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.68300000000000005}]},{"osd":4,"last update":"Sat Feb 10 08:37:05 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.25800000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.42099999999999999,"15min":0.42799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":1.103,"15min":1.103},"last":0.434}]},{"osd":6,"last update":"Sat Feb 10 08:36:21 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Feb 10 08:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.52700000000000002}]}]}]}} 2024-02-10T08:37:26.304 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-10T08:37:26.304 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-10T08:37:26.304 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-10T08:37:26.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- ceph health --format=json 2024-02-10T08:37:26.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:26 smithi145 bash[35820]: audit 2024-02-10T08:37:25.969078+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:25.968312\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:26.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:26 smithi145 bash[35820]: audit 2024-02-10T08:37:25.972986+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:25.968312\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:26.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:26 smithi040 bash[35794]: audit 2024-02-10T08:37:25.969078+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:25.968312\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:26.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:26 smithi040 bash[35794]: audit 2024-02-10T08:37:25.972986+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:25.968312\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:26.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:26 smithi040 bash[38951]: audit 2024-02-10T08:37:25.969078+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:25.968312\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:37:26.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:26 smithi040 bash[38951]: audit 2024-02-10T08:37:25.972986+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}}, \"last_daemon_update\": \"2024-02-10T08:37:25.968312\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:37:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:27 smithi145 bash[35820]: audit 2024-02-10T08:37:25.426052+0000 mgr.y (mgr.14140) 221 : audit [DBG] from='client.24460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:27 smithi145 bash[35820]: cluster 2024-02-10T08:37:26.198760+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:27.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:27 smithi040 bash[35794]: audit 2024-02-10T08:37:25.426052+0000 mgr.y (mgr.14140) 221 : audit [DBG] from='client.24460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:27.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:27 smithi040 bash[35794]: cluster 2024-02-10T08:37:26.198760+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:27 smithi040 bash[38951]: audit 2024-02-10T08:37:25.426052+0000 mgr.y (mgr.14140) 221 : audit [DBG] from='client.24460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-10T08:37:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:27 smithi040 bash[38951]: cluster 2024-02-10T08:37:26.198760+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:28.465 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:37:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:28 smithi145 bash[35820]: cluster 2024-02-10T08:37:28.199096+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:28 smithi040 bash[35794]: cluster 2024-02-10T08:37:28.199096+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:28 smithi040 bash[38951]: cluster 2024-02-10T08:37:28.199096+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-10T08:37:29.420 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-10T08:37:29.420 INFO:tasks.cephadm:Setup complete, yielding 2024-02-10T08:37:29.421 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-10T08:37:29.431 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T08:37:29.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-02-10T08:37:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:29 smithi040 bash[35794]: audit 2024-02-10T08:37:28.465555+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.40:0/1169654842' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-10T08:37:29.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:29 smithi040 bash[38951]: audit 2024-02-10T08:37:28.465555+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.40:0/1169654842' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-10T08:37:29.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:29 smithi145 bash[35820]: audit 2024-02-10T08:37:28.465555+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.40:0/1169654842' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-10T08:37:30.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:30 smithi040 bash[35794]: cluster 2024-02-10T08:37:30.199525+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:30.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:30 smithi040 bash[38951]: cluster 2024-02-10T08:37:30.199525+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:30 smithi145 bash[35820]: cluster 2024-02-10T08:37:30.199525+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:32.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:32 smithi040 bash[35794]: audit 2024-02-10T08:37:31.559654+0000 mon.a (mon.0) 520 : audit [INF] from='client.? 172.21.15.40:0/4242612868' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2024-02-10T08:37:32.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:32 smithi040 bash[35794]: audit 2024-02-10T08:37:31.565590+0000 mon.a (mon.0) 521 : audit [INF] from='client.? 172.21.15.40:0/4242612868' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2024-02-10T08:37:32.396 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:32 smithi040 bash[38951]: audit 2024-02-10T08:37:31.559654+0000 mon.a (mon.0) 520 : audit [INF] from='client.? 172.21.15.40:0/4242612868' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2024-02-10T08:37:32.396 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:32 smithi040 bash[38951]: audit 2024-02-10T08:37:31.565590+0000 mon.a (mon.0) 521 : audit [INF] from='client.? 172.21.15.40:0/4242612868' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2024-02-10T08:37:32.408 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-10T08:37:32.420 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T08:37:32.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-02-10T08:37:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:32 smithi145 bash[35820]: audit 2024-02-10T08:37:31.559654+0000 mon.a (mon.0) 520 : audit [INF] from='client.? 172.21.15.40:0/4242612868' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2024-02-10T08:37:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:32 smithi145 bash[35820]: audit 2024-02-10T08:37:31.565590+0000 mon.a (mon.0) 521 : audit [INF] from='client.? 172.21.15.40:0/4242612868' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2024-02-10T08:37:33.136 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:33 smithi040 bash[38951]: cluster 2024-02-10T08:37:32.199898+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:33.136 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:33 smithi040 bash[35794]: cluster 2024-02-10T08:37:32.199898+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:33 smithi145 bash[35820]: cluster 2024-02-10T08:37:32.199898+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:35.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:35 smithi145 bash[35820]: cluster 2024-02-10T08:37:34.200395+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:35 smithi040 bash[35794]: cluster 2024-02-10T08:37:34.200395+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:35 smithi040 bash[38951]: cluster 2024-02-10T08:37:34.200395+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:37:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "f3cc9608-bb6b-4e68-816c-161a50605097", 2024-02-10T08:37:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "r", 2024-02-10T08:37:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: "current_period": "aa7f9433-dd61-4f98-9f3c-1a4863fc9d4a", 2024-02-10T08:37:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 1 2024-02-10T08:37:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:37:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:36 smithi145 bash[35820]: cluster 2024-02-10T08:37:35.263783+0000 mon.a (mon.0) 522 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-10T08:37:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:36 smithi145 bash[35820]: audit 2024-02-10T08:37:35.265178+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.40:0/2568125093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:37:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:36 smithi145 bash[35820]: audit 2024-02-10T08:37:35.266191+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:37:36.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:36 smithi040 bash[35794]: cluster 2024-02-10T08:37:35.263783+0000 mon.a (mon.0) 522 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-10T08:37:36.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:36 smithi040 bash[35794]: audit 2024-02-10T08:37:35.265178+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.40:0/2568125093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:37:36.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:36 smithi040 bash[35794]: audit 2024-02-10T08:37:35.266191+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:37:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:36 smithi040 bash[38951]: cluster 2024-02-10T08:37:35.263783+0000 mon.a (mon.0) 522 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-10T08:37:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:36 smithi040 bash[38951]: audit 2024-02-10T08:37:35.265178+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.40:0/2568125093' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:37:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:36 smithi040 bash[38951]: audit 2024-02-10T08:37:35.266191+0000 mon.a (mon.0) 523 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-10T08:37:37.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-02-10T08:37:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:37 smithi040 bash[35794]: cluster 2024-02-10T08:37:36.200872+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v214: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:37 smithi040 bash[35794]: audit 2024-02-10T08:37:36.266137+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-10T08:37:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:37 smithi040 bash[35794]: cluster 2024-02-10T08:37:36.266301+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-10T08:37:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:37 smithi040 bash[38951]: cluster 2024-02-10T08:37:36.200872+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v214: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:37 smithi040 bash[38951]: audit 2024-02-10T08:37:36.266137+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-10T08:37:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:37 smithi040 bash[38951]: cluster 2024-02-10T08:37:36.266301+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-10T08:37:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:37 smithi145 bash[35820]: cluster 2024-02-10T08:37:36.200872+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v214: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:37 smithi145 bash[35820]: audit 2024-02-10T08:37:36.266137+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-10T08:37:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:37 smithi145 bash[35820]: cluster 2024-02-10T08:37:36.266301+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-10T08:37:38.607 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:38 smithi040 bash[35794]: cluster 2024-02-10T08:37:37.276294+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-10T08:37:38.608 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:38 smithi040 bash[35794]: cluster 2024-02-10T08:37:38.201189+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 33 pgs: 5 creating+peering, 21 unknown, 7 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:38.608 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:38 smithi040 bash[38951]: cluster 2024-02-10T08:37:37.276294+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-10T08:37:38.608 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:38 smithi040 bash[38951]: cluster 2024-02-10T08:37:38.201189+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 33 pgs: 5 creating+peering, 21 unknown, 7 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:38 smithi145 bash[35820]: cluster 2024-02-10T08:37:37.276294+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-10T08:37:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:38 smithi145 bash[35820]: cluster 2024-02-10T08:37:38.201189+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 33 pgs: 5 creating+peering, 21 unknown, 7 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:37:39.129 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:37:39.129 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "ad13d96e-13d8-44ec-8383-8366799c5712", 2024-02-10T08:37:39.129 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default", 2024-02-10T08:37:39.129 INFO:teuthology.orchestra.run.smithi040.stdout: "api_name": "default", 2024-02-10T08:37:39.129 INFO:teuthology.orchestra.run.smithi040.stdout: "is_master": "true", 2024-02-10T08:37:39.129 INFO:teuthology.orchestra.run.smithi040.stdout: "endpoints": [], 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames": [], 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames_s3website": [], 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zone": "", 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "zones": [], 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "placement_targets": [], 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "default_placement": "", 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "f3cc9608-bb6b-4e68-816c-161a50605097", 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_policy": { 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: "groups": [] 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:39.130 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:37:40.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-02-10T08:37:41.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:41 smithi040 bash[35794]: cluster 2024-02-10T08:37:40.201472+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 33 pgs: 5 creating+peering, 4 unknown, 24 active+clean; 437 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-10T08:37:41.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:41 smithi040 bash[38951]: cluster 2024-02-10T08:37:40.201472+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 33 pgs: 5 creating+peering, 4 unknown, 24 active+clean; 437 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-10T08:37:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:41 smithi145 bash[35820]: cluster 2024-02-10T08:37:40.201472+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 33 pgs: 5 creating+peering, 4 unknown, 24 active+clean; 437 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-10T08:37:42.034 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "35318dde-1f1f-4187-a18b-2ff846b4bcec", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "z", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "domain_root": "z.rgw.meta:root", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "control_pool": "z.rgw.control", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "gc_pool": "z.rgw.log:gc", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "lc_pool": "z.rgw.log:lc", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "log_pool": "z.rgw.log", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "roles_pool": "z.rgw.meta:roles", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-02-10T08:37:42.035 INFO:teuthology.orchestra.run.smithi040.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "otp_pool": "z.rgw.otp", 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "system_key": { 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "access_key": "", 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "secret_key": "" 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "placement_pools": [ 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "default-placement", 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "val": { 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "index_pool": "z.rgw.buckets.index", 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_classes": { 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "STANDARD": { 2024-02-10T08:37:42.036 INFO:teuthology.orchestra.run.smithi040.stdout: "data_pool": "z.rgw.buckets.data" 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: "index_type": 0 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "f3cc9608-bb6b-4e68-816c-161a50605097" 2024-02-10T08:37:42.037 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:37:42.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-02-10T08:37:43.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:43 smithi040 bash[35794]: cluster 2024-02-10T08:37:42.201950+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v219: 33 pgs: 33 active+clean; 772 B data, 3.9 MiB used, 707 GiB / 715 GiB avail; 295 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-10T08:37:43.418 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:43 smithi040 bash[38951]: cluster 2024-02-10T08:37:42.201950+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v219: 33 pgs: 33 active+clean; 772 B data, 3.9 MiB used, 707 GiB / 715 GiB avail; 295 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-10T08:37:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:43 smithi145 bash[35820]: cluster 2024-02-10T08:37:42.201950+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v219: 33 pgs: 33 active+clean; 772 B data, 3.9 MiB used, 707 GiB / 715 GiB avail; 295 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-10T08:37:45.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:45 smithi145 bash[35820]: cluster 2024-02-10T08:37:44.202497+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 33 pgs: 33 active+clean; 1.7 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-10T08:37:45.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:45 smithi040 bash[35794]: cluster 2024-02-10T08:37:44.202497+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 33 pgs: 33 active+clean; 1.7 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-10T08:37:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:45 smithi040 bash[38951]: cluster 2024-02-10T08:37:44.202497+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 33 pgs: 33 active+clean; 1.7 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 639 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-10T08:37:46.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:46 smithi145 bash[35820]: cluster 2024-02-10T08:37:45.271292+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-10T08:37:46.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:46 smithi145 bash[35820]: audit 2024-02-10T08:37:45.273387+0000 mon.c (mon.1) 23 : audit [INF] from='client.? 172.21.15.40:0/913311754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:37:46.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:46 smithi145 bash[35820]: audit 2024-02-10T08:37:45.274115+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:37:46.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:46 smithi040 bash[35794]: cluster 2024-02-10T08:37:45.271292+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-10T08:37:46.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:46 smithi040 bash[35794]: audit 2024-02-10T08:37:45.273387+0000 mon.c (mon.1) 23 : audit [INF] from='client.? 172.21.15.40:0/913311754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:37:46.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:46 smithi040 bash[35794]: audit 2024-02-10T08:37:45.274115+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:37:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:46 smithi040 bash[38951]: cluster 2024-02-10T08:37:45.271292+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-10T08:37:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:46 smithi040 bash[38951]: audit 2024-02-10T08:37:45.273387+0000 mon.c (mon.1) 23 : audit [INF] from='client.? 172.21.15.40:0/913311754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:37:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:46 smithi040 bash[38951]: audit 2024-02-10T08:37:45.274115+0000 mon.a (mon.0) 528 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-10T08:37:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:47 smithi040 bash[35794]: cluster 2024-02-10T08:37:46.202852+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v222: 65 pgs: 32 unknown, 33 active+clean; 1.8 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 802 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-02-10T08:37:47.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:47 smithi040 bash[35794]: audit 2024-02-10T08:37:46.273986+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-10T08:37:47.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:47 smithi040 bash[35794]: cluster 2024-02-10T08:37:46.274139+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-10T08:37:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:47 smithi040 bash[38951]: cluster 2024-02-10T08:37:46.202852+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v222: 65 pgs: 32 unknown, 33 active+clean; 1.8 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 802 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-02-10T08:37:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:47 smithi040 bash[38951]: audit 2024-02-10T08:37:46.273986+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-10T08:37:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:47 smithi040 bash[38951]: cluster 2024-02-10T08:37:46.274139+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-10T08:37:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:47 smithi145 bash[35820]: cluster 2024-02-10T08:37:46.202852+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v222: 65 pgs: 32 unknown, 33 active+clean; 1.8 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 802 B/s rd, 1.8 KiB/s wr, 3 op/s 2024-02-10T08:37:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:47 smithi145 bash[35820]: audit 2024-02-10T08:37:46.273986+0000 mon.a (mon.0) 529 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-10T08:37:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:47 smithi145 bash[35820]: cluster 2024-02-10T08:37:46.274139+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-10T08:37:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[35794]: cluster 2024-02-10T08:37:47.293168+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[35794]: audit 2024-02-10T08:37:47.299824+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.15.40:0/913311754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[35794]: audit 2024-02-10T08:37:47.300239+0000 mon.a (mon.0) 532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[35794]: cluster 2024-02-10T08:37:48.203233+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 97 pgs: 5 creating+peering, 53 unknown, 39 active+clean; 1.8 KiB data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[38951]: cluster 2024-02-10T08:37:47.293168+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[38951]: audit 2024-02-10T08:37:47.299824+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.15.40:0/913311754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[38951]: audit 2024-02-10T08:37:47.300239+0000 mon.a (mon.0) 532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:37:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:48 smithi040 bash[38951]: cluster 2024-02-10T08:37:48.203233+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 97 pgs: 5 creating+peering, 53 unknown, 39 active+clean; 1.8 KiB data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-10T08:37:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:48 smithi145 bash[35820]: cluster 2024-02-10T08:37:47.293168+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-10T08:37:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:48 smithi145 bash[35820]: audit 2024-02-10T08:37:47.299824+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.15.40:0/913311754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:37:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:48 smithi145 bash[35820]: audit 2024-02-10T08:37:47.300239+0000 mon.a (mon.0) 532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-10T08:37:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:48 smithi145 bash[35820]: cluster 2024-02-10T08:37:48.203233+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 97 pgs: 5 creating+peering, 53 unknown, 39 active+clean; 1.8 KiB data, 4.0 MiB used, 707 GiB / 715 GiB avail; 1.2 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-10T08:37:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:49 smithi040 bash[35794]: audit 2024-02-10T08:37:48.299506+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-10T08:37:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:49 smithi040 bash[35794]: cluster 2024-02-10T08:37:48.299560+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-10T08:37:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:49 smithi040 bash[38951]: audit 2024-02-10T08:37:48.299506+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-10T08:37:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:49 smithi040 bash[38951]: cluster 2024-02-10T08:37:48.299560+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-10T08:37:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:49 smithi145 bash[35820]: audit 2024-02-10T08:37:48.299506+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-10T08:37:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:49 smithi145 bash[35820]: cluster 2024-02-10T08:37:48.299560+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-10T08:37:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[35794]: cluster 2024-02-10T08:37:49.304444+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-10T08:37:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[35794]: audit 2024-02-10T08:37:49.309841+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:37:50.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[35794]: audit 2024-02-10T08:37:49.310707+0000 mon.a (mon.0) 536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:37:50.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[35794]: cluster 2024-02-10T08:37:50.203759+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v228: 129 pgs: 13 creating+peering, 32 unknown, 84 active+clean; 1.8 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-02-10T08:37:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[38951]: cluster 2024-02-10T08:37:49.304444+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-10T08:37:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[38951]: audit 2024-02-10T08:37:49.309841+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:37:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[38951]: audit 2024-02-10T08:37:49.310707+0000 mon.a (mon.0) 536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:37:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:50 smithi040 bash[38951]: cluster 2024-02-10T08:37:50.203759+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v228: 129 pgs: 13 creating+peering, 32 unknown, 84 active+clean; 1.8 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-02-10T08:37:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:50 smithi145 bash[35820]: cluster 2024-02-10T08:37:49.304444+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-10T08:37:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:50 smithi145 bash[35820]: audit 2024-02-10T08:37:49.309841+0000 mon.c (mon.1) 25 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:37:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:50 smithi145 bash[35820]: audit 2024-02-10T08:37:49.310707+0000 mon.a (mon.0) 536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-10T08:37:50.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:50 smithi145 bash[35820]: cluster 2024-02-10T08:37:50.203759+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v228: 129 pgs: 13 creating+peering, 32 unknown, 84 active+clean; 1.8 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-02-10T08:37:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[35794]: audit 2024-02-10T08:37:50.314018+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:37:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[35794]: cluster 2024-02-10T08:37:50.314122+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-10T08:37:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[35794]: audit 2024-02-10T08:37:50.317557+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:37:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[35794]: audit 2024-02-10T08:37:50.324877+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:37:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[38951]: audit 2024-02-10T08:37:50.314018+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:37:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[38951]: cluster 2024-02-10T08:37:50.314122+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-10T08:37:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[38951]: audit 2024-02-10T08:37:50.317557+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:37:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:51 smithi040 bash[38951]: audit 2024-02-10T08:37:50.324877+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:37:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:51 smithi145 bash[35820]: audit 2024-02-10T08:37:50.314018+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-10T08:37:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:51 smithi145 bash[35820]: cluster 2024-02-10T08:37:50.314122+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-10T08:37:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:51 smithi145 bash[35820]: audit 2024-02-10T08:37:50.317557+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:37:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:51 smithi145 bash[35820]: audit 2024-02-10T08:37:50.324877+0000 mon.a (mon.0) 539 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-10T08:37:52.421 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:37:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "c0fd7765-f110-4e15-ae47-0a1519ea098e", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 1, 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "predecessor_uuid": "aa7f9433-dd61-4f98-9f3c-1a4863fc9d4a", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_status": [], 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "period_map": { 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "c0fd7765-f110-4e15-ae47-0a1519ea098e", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "zonegroups": [ 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "ad13d96e-13d8-44ec-8383-8366799c5712", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "api_name": "default", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "is_master": "true", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "endpoints": [], 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames": [], 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "hostnames_s3website": [], 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zone": "35318dde-1f1f-4187-a18b-2ff846b4bcec", 2024-02-10T08:37:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "zones": [ 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "id": "35318dde-1f1f-4187-a18b-2ff846b4bcec", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "z", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "endpoints": [], 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "log_meta": "false", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "log_data": "false", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "bucket_index_max_shards": 11, 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "read_only": "false", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "tier_type": "", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_from_all": "true", 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_from": [], 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_zone": "" 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "placement_targets": [ 2024-02-10T08:37:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default-placement", 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_classes": [ 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "STANDARD" 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "default_placement": "default-placement", 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "f3cc9608-bb6b-4e68-816c-161a50605097", 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "sync_policy": { 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "groups": [] 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "short_zone_ids": [ 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "35318dde-1f1f-4187-a18b-2ff846b4bcec", 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "val": 3696993791 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zonegroup": "ad13d96e-13d8-44ec-8383-8366799c5712", 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "master_zone": "35318dde-1f1f-4187-a18b-2ff846b4bcec", 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "period_config": { 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "bucket_quota": { 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": false, 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "check_on_raw": false, 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size": -1, 2024-02-10T08:37:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size_kb": 0, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "max_objects": -1 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "user_quota": { 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": false, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "check_on_raw": false, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size": -1, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "max_size_kb": 0, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "max_objects": -1 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_id": "f3cc9608-bb6b-4e68-816c-161a50605097", 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_name": "r", 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "realm_epoch": 2 2024-02-10T08:37:52.426 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:37:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[35794]: audit 2024-02-10T08:37:51.322894+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:37:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[35794]: cluster 2024-02-10T08:37:51.322951+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-10T08:37:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[35794]: audit 2024-02-10T08:37:51.323599+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[35794]: audit 2024-02-10T08:37:51.323941+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[35794]: cluster 2024-02-10T08:37:52.204241+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v231: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[38951]: audit 2024-02-10T08:37:51.322894+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[38951]: cluster 2024-02-10T08:37:51.322951+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[38951]: audit 2024-02-10T08:37:51.323599+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[38951]: audit 2024-02-10T08:37:51.323941+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-10T08:37:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:52 smithi040 bash[38951]: cluster 2024-02-10T08:37:52.204241+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v231: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-02-10T08:37:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:52 smithi145 bash[35820]: audit 2024-02-10T08:37:51.322894+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-10T08:37:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:52 smithi145 bash[35820]: cluster 2024-02-10T08:37:51.322951+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-10T08:37:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:52 smithi145 bash[35820]: audit 2024-02-10T08:37:51.323599+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.40:0/442308398' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-10T08:37:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:52 smithi145 bash[35820]: audit 2024-02-10T08:37:51.323941+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-10T08:37:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:52 smithi145 bash[35820]: cluster 2024-02-10T08:37:52.204241+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v231: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-02-10T08:37:53.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch apply rgw r z --placement=2 --port=8000' 2024-02-10T08:37:53.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:53 smithi040 bash[35794]: audit 2024-02-10T08:37:52.329487+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-10T08:37:53.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:53 smithi040 bash[35794]: cluster 2024-02-10T08:37:52.329541+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-10T08:37:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:53 smithi040 bash[38951]: audit 2024-02-10T08:37:52.329487+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-10T08:37:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:53 smithi040 bash[38951]: cluster 2024-02-10T08:37:52.329541+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-10T08:37:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:53 smithi145 bash[35820]: audit 2024-02-10T08:37:52.329487+0000 mon.a (mon.0) 543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-10T08:37:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:53 smithi145 bash[35820]: cluster 2024-02-10T08:37:52.329541+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-10T08:37:54.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:54 smithi040 bash[35794]: cluster 2024-02-10T08:37:54.204685+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v233: 129 pgs: 8 creating+peering, 7 unknown, 114 active+clean; 3.9 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 835 B/s rd, 3.1 KiB/s wr, 11 op/s 2024-02-10T08:37:54.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:54 smithi040 bash[38951]: cluster 2024-02-10T08:37:54.204685+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v233: 129 pgs: 8 creating+peering, 7 unknown, 114 active+clean; 3.9 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 835 B/s rd, 3.1 KiB/s wr, 11 op/s 2024-02-10T08:37:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:54 smithi145 bash[35820]: cluster 2024-02-10T08:37:54.204685+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v233: 129 pgs: 8 creating+peering, 7 unknown, 114 active+clean; 3.9 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 835 B/s rd, 3.1 KiB/s wr, 11 op/s 2024-02-10T08:37:55.493 INFO:teuthology.orchestra.run.smithi040.stdout:Scheduled rgw update... 2024-02-10T08:37:55.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.488247+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-10T08:37:55.487916\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.491053+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-10T08:37:55.487916\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.492869+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.498494+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.499290+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.506109+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.506840+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.512085+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.512736+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.517523+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.518093+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:55.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[35794]: audit 2024-02-10T08:37:55.518877+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi040.skjeib", "key": "container_image"}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.488247+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-10T08:37:55.487916\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.491053+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-10T08:37:55.487916\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.492869+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.498494+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.499290+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.506109+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.506840+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.512085+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.512736+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.517523+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.518093+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:55 smithi040 bash[38951]: audit 2024-02-10T08:37:55.518877+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi040.skjeib", "key": "container_image"}]: dispatch 2024-02-10T08:37:56.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.488247+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-10T08:37:55.487916\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-10T08:37:56.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.491053+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-10T08:37:55.487916\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-10T08:37:56.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.492869+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-10T08:37:56.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.498494+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.499290+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.506109+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.506840+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.512085+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.512736+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.517523+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.518093+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:56.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:55 smithi145 bash[35820]: audit 2024-02-10T08:37:55.518877+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi040.skjeib", "key": "container_image"}]: dispatch 2024-02-10T08:37:56.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 180' 2024-02-10T08:37:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[35794]: audit 2024-02-10T08:37:55.487404+0000 mgr.y (mgr.14140) 237 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:37:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[35794]: cephadm 2024-02-10T08:37:55.487904+0000 mgr.y (mgr.14140) 238 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-10T08:37:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[35794]: cephadm 2024-02-10T08:37:55.518536+0000 mgr.y (mgr.14140) 239 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T08:37:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[35794]: cluster 2024-02-10T08:37:56.205452+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 5.0 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 4.5 KiB/s wr, 17 op/s 2024-02-10T08:37:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[38951]: audit 2024-02-10T08:37:55.487404+0000 mgr.y (mgr.14140) 237 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:37:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[38951]: cephadm 2024-02-10T08:37:55.487904+0000 mgr.y (mgr.14140) 238 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-10T08:37:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[38951]: cephadm 2024-02-10T08:37:55.518536+0000 mgr.y (mgr.14140) 239 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T08:37:57.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:57 smithi040 bash[38951]: cluster 2024-02-10T08:37:56.205452+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 5.0 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 4.5 KiB/s wr, 17 op/s 2024-02-10T08:37:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:57 smithi145 bash[35820]: audit 2024-02-10T08:37:55.487404+0000 mgr.y (mgr.14140) 237 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:37:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:57 smithi145 bash[35820]: cephadm 2024-02-10T08:37:55.487904+0000 mgr.y (mgr.14140) 238 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-10T08:37:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:57 smithi145 bash[35820]: cephadm 2024-02-10T08:37:55.518536+0000 mgr.y (mgr.14140) 239 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T08:37:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:57 smithi145 bash[35820]: cluster 2024-02-10T08:37:56.205452+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 5.0 KiB data, 5.0 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 4.5 KiB/s wr, 17 op/s 2024-02-10T08:37:59.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: cluster 2024-02-10T08:37:58.210827+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 907 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-02-10T08:37:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: cluster 2024-02-10T08:37:58.210827+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 907 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-02-10T08:37:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: audit 2024-02-10T08:37:59.092988+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: audit 2024-02-10T08:37:59.092988+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: audit 2024-02-10T08:37:59.096014+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: audit 2024-02-10T08:37:59.096512+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: audit 2024-02-10T08:37:59.099097+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: audit 2024-02-10T08:37:59.099702+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[35794]: audit 2024-02-10T08:37:59.100517+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi145.uizklq", "key": "container_image"}]: dispatch 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: audit 2024-02-10T08:37:59.096014+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: audit 2024-02-10T08:37:59.096512+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:37:59.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: audit 2024-02-10T08:37:59.099097+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-10T08:37:59.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: audit 2024-02-10T08:37:59.099702+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:59.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:37:59 smithi040 bash[38951]: audit 2024-02-10T08:37:59.100517+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi145.uizklq", "key": "container_image"}]: dispatch 2024-02-10T08:37:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: cluster 2024-02-10T08:37:58.210827+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 907 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-02-10T08:37:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: audit 2024-02-10T08:37:59.092988+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:37:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: audit 2024-02-10T08:37:59.096014+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389571\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389648\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389682\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389712\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389740\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389768\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389796\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389825\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:22.389853\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:37:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: audit 2024-02-10T08:37:59.096512+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-10T08:37:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: audit 2024-02-10T08:37:59.099097+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-10T08:37:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: audit 2024-02-10T08:37:59.099702+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:37:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:37:59 smithi145 bash[35820]: audit 2024-02-10T08:37:59.100517+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi145.uizklq", "key": "container_image"}]: dispatch 2024-02-10T08:38:00.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:00 smithi145 bash[35820]: cephadm 2024-02-10T08:37:59.100176+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Deploying daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T08:38:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:00 smithi040 bash[35794]: cephadm 2024-02-10T08:37:59.100176+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Deploying daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T08:38:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:00 smithi040 bash[38951]: cephadm 2024-02-10T08:37:59.100176+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Deploying daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T08:38:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:01 smithi145 bash[35820]: cluster 2024-02-10T08:38:00.211580+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 806 B/s rd, 4.4 KiB/s wr, 16 op/s 2024-02-10T08:38:01.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:01 smithi145 bash[35820]: audit 2024-02-10T08:38:01.011699+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:38:01.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:01 smithi145 bash[35820]: audit 2024-02-10T08:38:01.015012+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:38:01.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:01 smithi145 bash[35820]: audit 2024-02-10T08:38:01.015920+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:38:01.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[35794]: cluster 2024-02-10T08:38:00.211580+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 806 B/s rd, 4.4 KiB/s wr, 16 op/s 2024-02-10T08:38:01.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[38951]: cluster 2024-02-10T08:38:00.211580+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 806 B/s rd, 4.4 KiB/s wr, 16 op/s 2024-02-10T08:38:01.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[38951]: audit 2024-02-10T08:38:01.011699+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:38:01.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[38951]: audit 2024-02-10T08:38:01.015012+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:38:01.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[38951]: audit 2024-02-10T08:38:01.015920+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:38:01.579 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[35794]: audit 2024-02-10T08:38:01.011699+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:38:01.579 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[35794]: audit 2024-02-10T08:38:01.015012+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.967931\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968007\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968041\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968086\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968118\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968148\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968177\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968206\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:37:25.968234\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:38:01.579 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:01 smithi040 bash[35794]: audit 2024-02-10T08:38:01.015920+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:38:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:02 smithi145 bash[35820]: cluster 2024-02-10T08:38:02.212040+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 29 op/s 2024-02-10T08:38:02.650 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:02 smithi040 bash[35794]: cluster 2024-02-10T08:38:02.212040+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 29 op/s 2024-02-10T08:38:02.650 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:02 smithi040 bash[38951]: cluster 2024-02-10T08:38:02.212040+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 29 op/s 2024-02-10T08:38:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:04 smithi145 bash[35820]: audit 2024-02-10T08:38:04.149940+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:38:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:04 smithi145 bash[35820]: audit 2024-02-10T08:38:04.152970+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:38:04.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:04 smithi145 bash[35820]: audit 2024-02-10T08:38:04.153590+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:38:04.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:04 smithi040 bash[35794]: audit 2024-02-10T08:38:04.149940+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:38:04.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:04 smithi040 bash[35794]: audit 2024-02-10T08:38:04.152970+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:38:04.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:04 smithi040 bash[35794]: audit 2024-02-10T08:38:04.153590+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:38:04.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:04 smithi040 bash[38951]: audit 2024-02-10T08:38:04.149940+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]: dispatch 2024-02-10T08:38:04.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:04 smithi040 bash[38951]: audit 2024-02-10T08:38:04.152970+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:31:34.041238\"}"}]': finished 2024-02-10T08:38:04.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:04 smithi040 bash[38951]: audit 2024-02-10T08:38:04.153590+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:38:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:05 smithi145 bash[35820]: cluster 2024-02-10T08:38:04.212689+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 52 KiB/s rd, 3.4 KiB/s wr, 104 op/s 2024-02-10T08:38:05.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:05 smithi040 bash[35794]: cluster 2024-02-10T08:38:04.212689+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 52 KiB/s rd, 3.4 KiB/s wr, 104 op/s 2024-02-10T08:38:05.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:05 smithi040 bash[38951]: cluster 2024-02-10T08:38:04.212689+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 52 KiB/s rd, 3.4 KiB/s wr, 104 op/s 2024-02-10T08:38:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:07 smithi040 bash[35794]: cluster 2024-02-10T08:38:06.213297+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 2.2 KiB/s wr, 161 op/s 2024-02-10T08:38:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:07 smithi040 bash[38951]: cluster 2024-02-10T08:38:06.213297+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 2.2 KiB/s wr, 161 op/s 2024-02-10T08:38:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:07 smithi145 bash[35820]: cluster 2024-02-10T08:38:06.213297+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 2.2 KiB/s wr, 161 op/s 2024-02-10T08:38:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:08 smithi040 bash[35794]: audit 2024-02-10T08:38:07.783739+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782446\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:38:07.782801\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:38:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:08 smithi040 bash[38951]: audit 2024-02-10T08:38:07.783739+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782446\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:38:07.782801\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:38:08.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:08 smithi040 bash[38951]: audit 2024-02-10T08:38:07.787333+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782446\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:38:07.782801\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:38:08.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:08 smithi040 bash[35794]: audit 2024-02-10T08:38:07.787333+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782446\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:38:07.782801\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:38:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:08 smithi145 bash[35820]: audit 2024-02-10T08:38:07.783739+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782446\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:38:07.782801\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:38:08.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:08 smithi145 bash[35820]: audit 2024-02-10T08:38:07.787333+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"2097937e9e58\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782446\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:32:58.468663\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:56.449253\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:38:07.782801\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:38:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:09 smithi040 bash[35794]: cluster 2024-02-10T08:38:08.213956+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 1.2 KiB/s wr, 170 op/s 2024-02-10T08:38:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:09 smithi040 bash[38951]: cluster 2024-02-10T08:38:08.213956+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 1.2 KiB/s wr, 170 op/s 2024-02-10T08:38:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:09 smithi145 bash[35820]: cluster 2024-02-10T08:38:08.213956+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 1.2 KiB/s wr, 170 op/s 2024-02-10T08:38:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:11 smithi145 bash[35820]: cluster 2024-02-10T08:38:10.214745+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-10T08:38:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:11 smithi040 bash[35794]: cluster 2024-02-10T08:38:10.214745+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-10T08:38:11.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:11 smithi040 bash[38951]: cluster 2024-02-10T08:38:10.214745+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-10T08:38:13.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:13 smithi145 bash[35820]: cluster 2024-02-10T08:38:12.215247+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-10T08:38:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:13 smithi040 bash[35794]: cluster 2024-02-10T08:38:12.215247+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-10T08:38:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:13 smithi040 bash[38951]: cluster 2024-02-10T08:38:12.215247+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-10T08:38:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:14 smithi040 bash[35794]: cluster 2024-02-10T08:38:14.215885+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 87 KiB/s rd, 170 B/s wr, 154 op/s 2024-02-10T08:38:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:14 smithi040 bash[38951]: cluster 2024-02-10T08:38:14.215885+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 87 KiB/s rd, 170 B/s wr, 154 op/s 2024-02-10T08:38:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:14 smithi145 bash[35820]: cluster 2024-02-10T08:38:14.215885+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 87 KiB/s rd, 170 B/s wr, 154 op/s 2024-02-10T08:38:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:17 smithi040 bash[35794]: cluster 2024-02-10T08:38:16.216472+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 75 op/s 2024-02-10T08:38:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:17 smithi040 bash[38951]: cluster 2024-02-10T08:38:16.216472+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 75 op/s 2024-02-10T08:38:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:17 smithi145 bash[35820]: cluster 2024-02-10T08:38:16.216472+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 75 op/s 2024-02-10T08:38:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:19 smithi145 bash[35820]: cluster 2024-02-10T08:38:18.217139+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-10T08:38:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:19 smithi040 bash[35794]: cluster 2024-02-10T08:38:18.217139+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-10T08:38:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:19 smithi040 bash[38951]: cluster 2024-02-10T08:38:18.217139+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-10T08:38:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:21 smithi145 bash[35820]: cluster 2024-02-10T08:38:20.217714+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:21 smithi040 bash[35794]: cluster 2024-02-10T08:38:20.217714+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:21.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:21 smithi040 bash[38951]: cluster 2024-02-10T08:38:20.217714+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:22 smithi040 bash[35794]: cluster 2024-02-10T08:38:22.218318+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:22 smithi040 bash[38951]: cluster 2024-02-10T08:38:22.218318+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:22 smithi145 bash[35820]: cluster 2024-02-10T08:38:22.218318+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:25.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:25 smithi145 bash[35820]: cluster 2024-02-10T08:38:24.218826+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:25 smithi040 bash[35794]: cluster 2024-02-10T08:38:24.218826+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:25.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:25 smithi040 bash[38951]: cluster 2024-02-10T08:38:24.218826+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:27 smithi040 bash[35794]: cluster 2024-02-10T08:38:26.219527+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:27 smithi040 bash[38951]: cluster 2024-02-10T08:38:26.219527+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:27 smithi145 bash[35820]: cluster 2024-02-10T08:38:26.219527+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:29 smithi145 bash[35820]: cluster 2024-02-10T08:38:28.220220+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:29 smithi040 bash[35794]: cluster 2024-02-10T08:38:28.220220+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:29 smithi040 bash[38951]: cluster 2024-02-10T08:38:28.220220+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:30 smithi040 bash[35794]: cluster 2024-02-10T08:38:30.220983+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:30.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:30 smithi040 bash[38951]: cluster 2024-02-10T08:38:30.220983+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:30 smithi145 bash[35820]: cluster 2024-02-10T08:38:30.220983+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:33 smithi145 bash[35820]: cluster 2024-02-10T08:38:32.221546+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:33 smithi040 bash[35794]: cluster 2024-02-10T08:38:32.221546+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:33 smithi040 bash[38951]: cluster 2024-02-10T08:38:32.221546+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:34 smithi040 bash[35794]: cluster 2024-02-10T08:38:34.222193+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:34 smithi040 bash[38951]: cluster 2024-02-10T08:38:34.222193+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:34 smithi145 bash[35820]: cluster 2024-02-10T08:38:34.222193+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:37.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:37 smithi040 bash[35794]: cluster 2024-02-10T08:38:36.222778+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:37 smithi040 bash[38951]: cluster 2024-02-10T08:38:36.222778+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:37 smithi145 bash[35820]: cluster 2024-02-10T08:38:36.222778+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:39 smithi145 bash[35820]: cluster 2024-02-10T08:38:38.223323+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:39 smithi040 bash[35794]: cluster 2024-02-10T08:38:38.223323+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:39 smithi040 bash[38951]: cluster 2024-02-10T08:38:38.223323+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:40 smithi040 bash[35794]: cluster 2024-02-10T08:38:40.223930+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:40 smithi040 bash[38951]: cluster 2024-02-10T08:38:40.223930+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:40 smithi145 bash[35820]: cluster 2024-02-10T08:38:40.223930+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:43 smithi145 bash[35820]: cluster 2024-02-10T08:38:42.224471+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:43 smithi040 bash[35794]: cluster 2024-02-10T08:38:42.224471+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:43.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:43 smithi040 bash[38951]: cluster 2024-02-10T08:38:42.224471+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:44 smithi040 bash[35794]: cluster 2024-02-10T08:38:44.225022+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:44.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:44 smithi040 bash[38951]: cluster 2024-02-10T08:38:44.225022+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:44 smithi145 bash[35820]: cluster 2024-02-10T08:38:44.225022+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:47 smithi040 bash[35794]: cluster 2024-02-10T08:38:46.225659+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:47 smithi040 bash[38951]: cluster 2024-02-10T08:38:46.225659+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:47 smithi145 bash[35820]: cluster 2024-02-10T08:38:46.225659+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:49 smithi145 bash[35820]: cluster 2024-02-10T08:38:48.226182+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:49 smithi040 bash[35794]: cluster 2024-02-10T08:38:48.226182+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:49.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:49 smithi040 bash[38951]: cluster 2024-02-10T08:38:48.226182+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:50 smithi040 bash[35794]: cluster 2024-02-10T08:38:50.226843+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:50 smithi040 bash[38951]: cluster 2024-02-10T08:38:50.226843+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:50 smithi145 bash[35820]: cluster 2024-02-10T08:38:50.226843+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:52 smithi040 bash[35794]: cluster 2024-02-10T08:38:52.227308+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:52 smithi040 bash[38951]: cluster 2024-02-10T08:38:52.227308+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:52 smithi145 bash[35820]: cluster 2024-02-10T08:38:52.227308+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:54 smithi040 bash[35794]: cluster 2024-02-10T08:38:54.227966+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:54.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:54 smithi040 bash[38951]: cluster 2024-02-10T08:38:54.227966+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:54 smithi145 bash[35820]: cluster 2024-02-10T08:38:54.227966+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:57 smithi040 bash[35794]: cluster 2024-02-10T08:38:56.228479+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:57 smithi040 bash[38951]: cluster 2024-02-10T08:38:56.228479+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:57 smithi145 bash[35820]: cluster 2024-02-10T08:38:56.228479+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:38:58 smithi040 bash[35794]: cluster 2024-02-10T08:38:58.228969+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:58.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:38:58 smithi040 bash[38951]: cluster 2024-02-10T08:38:58.228969+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:38:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:38:58 smithi145 bash[35820]: cluster 2024-02-10T08:38:58.228969+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:00 smithi040 bash[35794]: cluster 2024-02-10T08:39:00.229642+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:00 smithi040 bash[38951]: cluster 2024-02-10T08:39:00.229642+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:00 smithi145 bash[35820]: cluster 2024-02-10T08:39:00.229642+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:02 smithi040 bash[35794]: cluster 2024-02-10T08:39:02.230127+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:02 smithi040 bash[38951]: cluster 2024-02-10T08:39:02.230127+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:02 smithi145 bash[35820]: cluster 2024-02-10T08:39:02.230127+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:04 smithi040 bash[35794]: cluster 2024-02-10T08:39:04.230863+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:04 smithi040 bash[38951]: cluster 2024-02-10T08:39:04.230863+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:04 smithi145 bash[35820]: cluster 2024-02-10T08:39:04.230863+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:07 smithi040 bash[35794]: cluster 2024-02-10T08:39:06.231408+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:07 smithi040 bash[38951]: cluster 2024-02-10T08:39:06.231408+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:07 smithi145 bash[35820]: cluster 2024-02-10T08:39:06.231408+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:08 smithi040 bash[35794]: cluster 2024-02-10T08:39:08.231896+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:08 smithi040 bash[38951]: cluster 2024-02-10T08:39:08.231896+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:08 smithi145 bash[35820]: cluster 2024-02-10T08:39:08.231896+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:10 smithi040 bash[35794]: cluster 2024-02-10T08:39:10.232695+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:10 smithi040 bash[38951]: cluster 2024-02-10T08:39:10.232695+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:10 smithi145 bash[35820]: cluster 2024-02-10T08:39:10.232695+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:12 smithi040 bash[35794]: cluster 2024-02-10T08:39:12.233315+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:12 smithi040 bash[38951]: cluster 2024-02-10T08:39:12.233315+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:12 smithi145 bash[35820]: cluster 2024-02-10T08:39:12.233315+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:14 smithi040 bash[35794]: cluster 2024-02-10T08:39:14.233998+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:14.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:14 smithi040 bash[38951]: cluster 2024-02-10T08:39:14.233998+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:14 smithi145 bash[35820]: cluster 2024-02-10T08:39:14.233998+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:17 smithi040 bash[35794]: cluster 2024-02-10T08:39:16.234484+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:17 smithi040 bash[38951]: cluster 2024-02-10T08:39:16.234484+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:17 smithi145 bash[35820]: cluster 2024-02-10T08:39:16.234484+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:18 smithi040 bash[35794]: cluster 2024-02-10T08:39:18.235128+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:18 smithi040 bash[38951]: cluster 2024-02-10T08:39:18.235128+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:18 smithi145 bash[35820]: cluster 2024-02-10T08:39:18.235128+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:20.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:20 smithi040 bash[35794]: cluster 2024-02-10T08:39:20.235885+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:20.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:20 smithi040 bash[38951]: cluster 2024-02-10T08:39:20.235885+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:20 smithi145 bash[35820]: cluster 2024-02-10T08:39:20.235885+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:22 smithi040 bash[35794]: cluster 2024-02-10T08:39:22.236334+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:22 smithi040 bash[38951]: cluster 2024-02-10T08:39:22.236334+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:22 smithi145 bash[35820]: cluster 2024-02-10T08:39:22.236334+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:24.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:24 smithi040 bash[35794]: cluster 2024-02-10T08:39:24.236970+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:24 smithi040 bash[38951]: cluster 2024-02-10T08:39:24.236970+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:24 smithi145 bash[35820]: cluster 2024-02-10T08:39:24.236970+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:27 smithi040 bash[35794]: cluster 2024-02-10T08:39:26.237646+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:27 smithi040 bash[38951]: cluster 2024-02-10T08:39:26.237646+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:27 smithi145 bash[35820]: cluster 2024-02-10T08:39:26.237646+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:28 smithi040 bash[35794]: cluster 2024-02-10T08:39:28.238237+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:28 smithi040 bash[38951]: cluster 2024-02-10T08:39:28.238237+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:28 smithi145 bash[35820]: cluster 2024-02-10T08:39:28.238237+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:30 smithi040 bash[35794]: cluster 2024-02-10T08:39:30.238941+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:30.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:30 smithi040 bash[38951]: cluster 2024-02-10T08:39:30.238941+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:30 smithi145 bash[35820]: cluster 2024-02-10T08:39:30.238941+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:32 smithi040 bash[35794]: cluster 2024-02-10T08:39:32.239363+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:32 smithi040 bash[38951]: cluster 2024-02-10T08:39:32.239363+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:32 smithi145 bash[35820]: cluster 2024-02-10T08:39:32.239363+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:34.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:34 smithi040 bash[35794]: cluster 2024-02-10T08:39:34.239853+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:34.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:34 smithi040 bash[38951]: cluster 2024-02-10T08:39:34.239853+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:34 smithi145 bash[35820]: cluster 2024-02-10T08:39:34.239853+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:37.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:37 smithi040 bash[35794]: cluster 2024-02-10T08:39:36.240439+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:37 smithi040 bash[38951]: cluster 2024-02-10T08:39:36.240439+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:37 smithi145 bash[35820]: cluster 2024-02-10T08:39:36.240439+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:38.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:38 smithi040 bash[35794]: cluster 2024-02-10T08:39:38.240978+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:38.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:38 smithi040 bash[38951]: cluster 2024-02-10T08:39:38.240978+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:38 smithi145 bash[35820]: cluster 2024-02-10T08:39:38.240978+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:40 smithi040 bash[35794]: cluster 2024-02-10T08:39:40.241569+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:40 smithi040 bash[38951]: cluster 2024-02-10T08:39:40.241569+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:40 smithi145 bash[35820]: cluster 2024-02-10T08:39:40.241569+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:42 smithi040 bash[35794]: cluster 2024-02-10T08:39:42.242021+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:42.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:42 smithi040 bash[38951]: cluster 2024-02-10T08:39:42.242021+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:42 smithi145 bash[35820]: cluster 2024-02-10T08:39:42.242021+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:44 smithi040 bash[35794]: cluster 2024-02-10T08:39:44.242682+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:44 smithi040 bash[38951]: cluster 2024-02-10T08:39:44.242682+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:44 smithi145 bash[35820]: cluster 2024-02-10T08:39:44.242682+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:47 smithi040 bash[35794]: cluster 2024-02-10T08:39:46.243274+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:47.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:47 smithi040 bash[38951]: cluster 2024-02-10T08:39:46.243274+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:47 smithi145 bash[35820]: cluster 2024-02-10T08:39:46.243274+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:48 smithi040 bash[35794]: cluster 2024-02-10T08:39:48.243756+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:48 smithi040 bash[38951]: cluster 2024-02-10T08:39:48.243756+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:48 smithi145 bash[35820]: cluster 2024-02-10T08:39:48.243756+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:50 smithi040 bash[35794]: cluster 2024-02-10T08:39:50.244466+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:50 smithi040 bash[38951]: cluster 2024-02-10T08:39:50.244466+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:50 smithi145 bash[35820]: cluster 2024-02-10T08:39:50.244466+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:52 smithi040 bash[35794]: cluster 2024-02-10T08:39:52.244970+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:52 smithi040 bash[38951]: cluster 2024-02-10T08:39:52.244970+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:52 smithi145 bash[35820]: cluster 2024-02-10T08:39:52.244970+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:54 smithi040 bash[35794]: cluster 2024-02-10T08:39:54.245683+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:54.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:54 smithi040 bash[38951]: cluster 2024-02-10T08:39:54.245683+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:54 smithi145 bash[35820]: cluster 2024-02-10T08:39:54.245683+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:57 smithi040 bash[35794]: cluster 2024-02-10T08:39:56.246329+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:57 smithi040 bash[38951]: cluster 2024-02-10T08:39:56.246329+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:57 smithi145 bash[35820]: cluster 2024-02-10T08:39:56.246329+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:39:58 smithi040 bash[35794]: cluster 2024-02-10T08:39:58.246975+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:58.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:39:58 smithi040 bash[38951]: cluster 2024-02-10T08:39:58.246975+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:39:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:39:58 smithi145 bash[35820]: cluster 2024-02-10T08:39:58.246975+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:00 smithi040 bash[35794]: cluster 2024-02-10T08:40:00.247736+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:00 smithi040 bash[38951]: cluster 2024-02-10T08:40:00.247736+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:00 smithi145 bash[35820]: cluster 2024-02-10T08:40:00.247736+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:02 smithi040 bash[35794]: cluster 2024-02-10T08:40:02.248167+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:02 smithi040 bash[38951]: cluster 2024-02-10T08:40:02.248167+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:02 smithi145 bash[35820]: cluster 2024-02-10T08:40:02.248167+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:04 smithi040 bash[35794]: cluster 2024-02-10T08:40:04.248844+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:04 smithi040 bash[38951]: cluster 2024-02-10T08:40:04.248844+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:04 smithi145 bash[35820]: cluster 2024-02-10T08:40:04.248844+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:07 smithi040 bash[35794]: cluster 2024-02-10T08:40:06.249527+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:07 smithi040 bash[38951]: cluster 2024-02-10T08:40:06.249527+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:07 smithi145 bash[35820]: cluster 2024-02-10T08:40:06.249527+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:08 smithi040 bash[35794]: cluster 2024-02-10T08:40:08.250209+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:08 smithi040 bash[38951]: cluster 2024-02-10T08:40:08.250209+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:08 smithi145 bash[35820]: cluster 2024-02-10T08:40:08.250209+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:10 smithi040 bash[35794]: cluster 2024-02-10T08:40:10.250917+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:10 smithi040 bash[38951]: cluster 2024-02-10T08:40:10.250917+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:10 smithi145 bash[35820]: cluster 2024-02-10T08:40:10.250917+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:12 smithi040 bash[35794]: cluster 2024-02-10T08:40:12.251353+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:12 smithi040 bash[38951]: cluster 2024-02-10T08:40:12.251353+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:12 smithi145 bash[35820]: cluster 2024-02-10T08:40:12.251353+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:14 smithi040 bash[35794]: cluster 2024-02-10T08:40:14.251877+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:14 smithi040 bash[38951]: cluster 2024-02-10T08:40:14.251877+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:14 smithi145 bash[35820]: cluster 2024-02-10T08:40:14.251877+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:17.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:17 smithi040 bash[35794]: cluster 2024-02-10T08:40:16.252487+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:17.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:17 smithi040 bash[38951]: cluster 2024-02-10T08:40:16.252487+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:17 smithi145 bash[35820]: cluster 2024-02-10T08:40:16.252487+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:18 smithi040 bash[35794]: cluster 2024-02-10T08:40:18.253004+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:18 smithi040 bash[38951]: cluster 2024-02-10T08:40:18.253004+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:18 smithi145 bash[35820]: cluster 2024-02-10T08:40:18.253004+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:20 smithi040 bash[35794]: cluster 2024-02-10T08:40:20.253719+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:20.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:20 smithi040 bash[38951]: cluster 2024-02-10T08:40:20.253719+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:20 smithi145 bash[35820]: cluster 2024-02-10T08:40:20.253719+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:22 smithi040 bash[35794]: cluster 2024-02-10T08:40:22.254212+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:22.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:22 smithi040 bash[38951]: cluster 2024-02-10T08:40:22.254212+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:22 smithi145 bash[35820]: cluster 2024-02-10T08:40:22.254212+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:24.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:24 smithi040 bash[35794]: cluster 2024-02-10T08:40:24.254699+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:24 smithi040 bash[38951]: cluster 2024-02-10T08:40:24.254699+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:24 smithi145 bash[35820]: cluster 2024-02-10T08:40:24.254699+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:27 smithi040 bash[35794]: cluster 2024-02-10T08:40:26.255252+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:27 smithi040 bash[38951]: cluster 2024-02-10T08:40:26.255252+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:27 smithi145 bash[35820]: cluster 2024-02-10T08:40:26.255252+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:28 smithi040 bash[35794]: cluster 2024-02-10T08:40:28.255768+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:28 smithi040 bash[38951]: cluster 2024-02-10T08:40:28.255768+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:28 smithi145 bash[35820]: cluster 2024-02-10T08:40:28.255768+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:30 smithi040 bash[35794]: cluster 2024-02-10T08:40:30.256576+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:30.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:30 smithi040 bash[38951]: cluster 2024-02-10T08:40:30.256576+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:30 smithi145 bash[35820]: cluster 2024-02-10T08:40:30.256576+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:32 smithi040 bash[35794]: cluster 2024-02-10T08:40:32.257184+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:32 smithi040 bash[38951]: cluster 2024-02-10T08:40:32.257184+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:32 smithi145 bash[35820]: cluster 2024-02-10T08:40:32.257184+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:34 smithi040 bash[35794]: cluster 2024-02-10T08:40:34.257801+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:34 smithi040 bash[38951]: cluster 2024-02-10T08:40:34.257801+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:34 smithi145 bash[35820]: cluster 2024-02-10T08:40:34.257801+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:37 smithi145 bash[35820]: cluster 2024-02-10T08:40:36.258281+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:37.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:37 smithi040 bash[38951]: cluster 2024-02-10T08:40:36.258281+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:37 smithi040 bash[35794]: cluster 2024-02-10T08:40:36.258281+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:38.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:38 smithi040 bash[35794]: cluster 2024-02-10T08:40:38.258879+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:38.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:38 smithi040 bash[38951]: cluster 2024-02-10T08:40:38.258879+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:38 smithi145 bash[35820]: cluster 2024-02-10T08:40:38.258879+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:40 smithi040 bash[35794]: cluster 2024-02-10T08:40:40.259639+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:40.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:40 smithi040 bash[38951]: cluster 2024-02-10T08:40:40.259639+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:40 smithi145 bash[35820]: cluster 2024-02-10T08:40:40.259639+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:42 smithi040 bash[35794]: cluster 2024-02-10T08:40:42.260102+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:42 smithi040 bash[38951]: cluster 2024-02-10T08:40:42.260102+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:42 smithi145 bash[35820]: cluster 2024-02-10T08:40:42.260102+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:44 smithi040 bash[35794]: cluster 2024-02-10T08:40:44.260644+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:44 smithi040 bash[38951]: cluster 2024-02-10T08:40:44.260644+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:44 smithi145 bash[35820]: cluster 2024-02-10T08:40:44.260644+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:47 smithi040 bash[35794]: cluster 2024-02-10T08:40:46.261342+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:47.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:47 smithi040 bash[38951]: cluster 2024-02-10T08:40:46.261342+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:47 smithi145 bash[35820]: cluster 2024-02-10T08:40:46.261342+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:48 smithi040 bash[35794]: cluster 2024-02-10T08:40:48.261787+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:48 smithi040 bash[38951]: cluster 2024-02-10T08:40:48.261787+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:48 smithi145 bash[35820]: cluster 2024-02-10T08:40:48.261787+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:50 smithi040 bash[35794]: cluster 2024-02-10T08:40:50.262632+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:50 smithi040 bash[38951]: cluster 2024-02-10T08:40:50.262632+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:50.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:50 smithi145 bash[35820]: cluster 2024-02-10T08:40:50.262632+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:52 smithi040 bash[35794]: cluster 2024-02-10T08:40:52.263056+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:52 smithi040 bash[38951]: cluster 2024-02-10T08:40:52.263056+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:52 smithi145 bash[35820]: cluster 2024-02-10T08:40:52.263056+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:54 smithi040 bash[35794]: cluster 2024-02-10T08:40:54.263782+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:54.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:54 smithi040 bash[38951]: cluster 2024-02-10T08:40:54.263782+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:54 smithi145 bash[35820]: cluster 2024-02-10T08:40:54.263782+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:57 smithi145 bash[35820]: cluster 2024-02-10T08:40:56.264423+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:57 smithi040 bash[35794]: cluster 2024-02-10T08:40:56.264423+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:57 smithi040 bash[38951]: cluster 2024-02-10T08:40:56.264423+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:40:58 smithi040 bash[35794]: cluster 2024-02-10T08:40:58.265047+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:58.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:40:58 smithi040 bash[38951]: cluster 2024-02-10T08:40:58.265047+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:40:58 smithi145 bash[35820]: cluster 2024-02-10T08:40:58.265047+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:40:59.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-10T08:41:00.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:00 smithi040 bash[35794]: cluster 2024-02-10T08:41:00.265567+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:00.657 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:00 smithi040 bash[38951]: cluster 2024-02-10T08:41:00.265567+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:00 smithi145 bash[35820]: cluster 2024-02-10T08:41:00.265567+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[35794]: cluster 2024-02-10T08:41:02.265995+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[35794]: audit 2024-02-10T08:41:02.342368+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.40:0/1738663689' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[35794]: audit 2024-02-10T08:41:02.342649+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[35794]: audit 2024-02-10T08:41:02.348254+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[38951]: cluster 2024-02-10T08:41:02.265995+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[38951]: audit 2024-02-10T08:41:02.342368+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.40:0/1738663689' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[38951]: audit 2024-02-10T08:41:02.342649+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:02 smithi040 bash[38951]: audit 2024-02-10T08:41:02.348254+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-10T08:41:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:02 smithi145 bash[35820]: cluster 2024-02-10T08:41:02.265995+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:02 smithi145 bash[35820]: audit 2024-02-10T08:41:02.342368+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.40:0/1738663689' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:02 smithi145 bash[35820]: audit 2024-02-10T08:41:02.342649+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:02 smithi145 bash[35820]: audit 2024-02-10T08:41:02.348254+0000 mon.a (mon.0) 572 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-10T08:41:03.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-10T08:41:04.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:04 smithi040 bash[35794]: cluster 2024-02-10T08:41:04.266652+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:04 smithi040 bash[38951]: cluster 2024-02-10T08:41:04.266652+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:04 smithi145 bash[35820]: cluster 2024-02-10T08:41:04.266652+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:05.970 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:05 smithi040 bash[38951]: audit 2024-02-10T08:41:05.641441+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.40:0/160530038' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:05.971 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:05 smithi040 bash[38951]: audit 2024-02-10T08:41:05.641722+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:05.971 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:05 smithi040 bash[38951]: audit 2024-02-10T08:41:05.645122+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-10T08:41:05.971 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:05 smithi040 bash[35794]: audit 2024-02-10T08:41:05.641441+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.40:0/160530038' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:05.971 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:05 smithi040 bash[35794]: audit 2024-02-10T08:41:05.641722+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:05.971 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:05 smithi040 bash[35794]: audit 2024-02-10T08:41:05.645122+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-10T08:41:06.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:05 smithi145 bash[35820]: audit 2024-02-10T08:41:05.641441+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.40:0/160530038' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:06.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:05 smithi145 bash[35820]: audit 2024-02-10T08:41:05.641722+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:06.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:05 smithi145 bash[35820]: audit 2024-02-10T08:41:05.645122+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-10T08:41:06.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-10T08:41:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:07 smithi040 bash[35794]: cluster 2024-02-10T08:41:06.267330+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:07 smithi040 bash[38951]: cluster 2024-02-10T08:41:06.267330+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:07 smithi145 bash[35820]: cluster 2024-02-10T08:41:06.267330+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:08 smithi040 bash[35794]: cluster 2024-02-10T08:41:08.268001+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:08 smithi040 bash[38951]: cluster 2024-02-10T08:41:08.268001+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:08 smithi145 bash[35820]: cluster 2024-02-10T08:41:08.268001+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:09 smithi040 bash[35794]: audit 2024-02-10T08:41:08.731652+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.40:0/1949635014' entity='client.admin' cmd=[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:09 smithi040 bash[35794]: audit 2024-02-10T08:41:08.731967+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:09 smithi040 bash[35794]: audit 2024-02-10T08:41:08.737197+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]': finished 2024-02-10T08:41:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:09 smithi040 bash[38951]: audit 2024-02-10T08:41:08.731652+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.40:0/1949635014' entity='client.admin' cmd=[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:09 smithi040 bash[38951]: audit 2024-02-10T08:41:08.731967+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:09 smithi040 bash[38951]: audit 2024-02-10T08:41:08.737197+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]': finished 2024-02-10T08:41:09.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T08:41:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:09 smithi145 bash[35820]: audit 2024-02-10T08:41:08.731652+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.40:0/1949635014' entity='client.admin' cmd=[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:09 smithi145 bash[35820]: audit 2024-02-10T08:41:08.731967+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]: dispatch 2024-02-10T08:41:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:09 smithi145 bash[35820]: audit 2024-02-10T08:41:08.737197+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "global", "name": "log_to_journald", "value": "false", "force": true}]': finished 2024-02-10T08:41:10.360 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:10 smithi040 bash[38951]: cluster 2024-02-10T08:41:10.268493+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:10 smithi040 bash[35794]: cluster 2024-02-10T08:41:10.268493+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:10 smithi145 bash[35820]: cluster 2024-02-10T08:41:10.268493+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:11.971 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-10T08:41:11.971 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (4m) 3m ago 4m docker.io/prom/alertmanager:latest 9f27df16978d 058a51d56bd4 2024-02-10T08:41:11.971 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (4m) 3m ago 4m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c def7846928ea 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2097937e9e58 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e1e38dadb5ff 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (4m) 3m ago 5m docker.io/prom/node-exporter:latest 72c9c2088986 499f0f53e04a 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (4m) 3m ago 5m docker.io/prom/node-exporter:latest 72c9c2088986 b3a2408fef6b 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (5m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:41:11.972 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:41:11.973 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (4m) 3m ago 5m docker.io/prom/prometheus:latest 2a72b385beaf 2da2a296a6e5 2024-02-10T08:41:11.973 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:41:11.973 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:41:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:12 smithi040 bash[35794]: audit 2024-02-10T08:41:11.967250+0000 mgr.y (mgr.14140) 339 : audit [DBG] from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:12 smithi040 bash[35794]: cluster 2024-02-10T08:41:12.268859+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:12 smithi040 bash[38951]: audit 2024-02-10T08:41:11.967250+0000 mgr.y (mgr.14140) 339 : audit [DBG] from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:12 smithi040 bash[38951]: cluster 2024-02-10T08:41:12.268859+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:12 smithi145 bash[35820]: audit 2024-02-10T08:41:11.967250+0000 mgr.y (mgr.14140) 339 : audit [DBG] from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:12 smithi145 bash[35820]: cluster 2024-02-10T08:41:12.268859+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:12.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T08:41:14.561 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:14 smithi040 bash[35794]: cluster 2024-02-10T08:41:14.269488+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:14.561 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:14 smithi040 bash[38951]: cluster 2024-02-10T08:41:14.269488+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:14 smithi145 bash[35820]: cluster 2024-02-10T08:41:14.269488+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:14.976 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:41:14.977 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-10T08:41:14.978 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:41:14.978 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:41:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:15 smithi040 bash[35794]: audit 2024-02-10T08:41:14.976821+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.40:0/354030941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:41:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:15 smithi040 bash[38951]: audit 2024-02-10T08:41:14.976821+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.40:0/354030941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:41:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:15 smithi145 bash[35820]: audit 2024-02-10T08:41:14.976821+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.40:0/354030941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:41:15.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph -s' 2024-02-10T08:41:17.322 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:17 smithi040 bash[35794]: cluster 2024-02-10T08:41:16.269893+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:17.323 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:17 smithi040 bash[38951]: cluster 2024-02-10T08:41:16.269893+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:17 smithi145 bash[35820]: cluster 2024-02-10T08:41:16.269893+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:18.064 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: id: a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 8m) 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: y(active, since 9m), standbys: x 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.skjeib, r.z.smithi145.uizklq) 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:41:18.065 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-10T08:41:18.066 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 5 pools, 129 pgs 2024-02-10T08:41:18.066 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.0 KiB 2024-02-10T08:41:18.066 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:18.066 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 129 active+clean 2024-02-10T08:41:18.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:41:18.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:18 smithi040 bash[35794]: audit 2024-02-10T08:41:18.064726+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.40:0/2224195625' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:41:18.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:18 smithi040 bash[38951]: audit 2024-02-10T08:41:18.064726+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.40:0/2224195625' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:41:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:18 smithi145 bash[35820]: audit 2024-02-10T08:41:18.064726+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.40:0/2224195625' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:41:18.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ls' 2024-02-10T08:41:19.466 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:19 smithi040 bash[35794]: cluster 2024-02-10T08:41:18.270305+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:19.466 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:19 smithi040 bash[38951]: cluster 2024-02-10T08:41:18.270305+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:19 smithi145 bash[35820]: cluster 2024-02-10T08:41:18.270305+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:20 smithi040 bash[35794]: cluster 2024-02-10T08:41:20.271051+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:20.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:20 smithi040 bash[38951]: cluster 2024-02-10T08:41:20.271051+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:20 smithi145 bash[35820]: cluster 2024-02-10T08:41:20.271051+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:21.127 INFO:teuthology.orchestra.run.smithi040.stdout:NAME RUNNING REFRESHED AGE PLACEMENT IMAGE NAME IMAGE ID 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager 1/1 3m ago 5m count:1 smithi040=a docker.io/prom/alertmanager:latest 9f27df16978d 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:grafana 1/1 3m ago 5m count:1 smithi145=a docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:mgr 2/2 3m ago 8m count:2 smithi040=y,smithi145=x docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:mon 3/0 3m ago - docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter 2/2 3m ago 5m count:2 smithi040=a,smithi145=b docker.io/prom/node-exporter:latest 72c9c2088986 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus 1/1 3m ago 5m count:1 smithi145=a docker.io/prom/prometheus:latest 2a72b385beaf 2024-02-10T08:41:21.128 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z 2/2 3m ago 3m count:2 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2024-02-10T08:41:22.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mgr container_image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-10T08:41:22.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:22 smithi040 bash[35794]: audit 2024-02-10T08:41:21.125709+0000 mgr.y (mgr.14140) 345 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:22.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:22 smithi040 bash[38951]: audit 2024-02-10T08:41:21.125709+0000 mgr.y (mgr.14140) 345 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:22 smithi145 bash[35820]: audit 2024-02-10T08:41:21.125709+0000 mgr.y (mgr.14140) 345 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:23 smithi145 bash[35820]: cluster 2024-02-10T08:41:22.271576+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:23.659 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:23 smithi040 bash[35794]: cluster 2024-02-10T08:41:22.271576+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:23.660 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:23 smithi040 bash[38951]: cluster 2024-02-10T08:41:22.271576+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:24.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:24 smithi040 bash[35794]: cluster 2024-02-10T08:41:24.272035+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:24 smithi040 bash[38951]: cluster 2024-02-10T08:41:24.272035+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:24 smithi145 bash[35820]: cluster 2024-02-10T08:41:24.272035+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:25.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)"' 2024-02-10T08:41:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:25 smithi040 bash[38951]: audit 2024-02-10T08:41:24.397280+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.40:0/2145316338' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]: dispatch 2024-02-10T08:41:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:25 smithi040 bash[38951]: audit 2024-02-10T08:41:24.397538+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]: dispatch 2024-02-10T08:41:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:25 smithi040 bash[38951]: audit 2024-02-10T08:41:24.400939+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]': finished 2024-02-10T08:41:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:25 smithi040 bash[35794]: audit 2024-02-10T08:41:24.397280+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.40:0/2145316338' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]: dispatch 2024-02-10T08:41:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:25 smithi040 bash[35794]: audit 2024-02-10T08:41:24.397538+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]: dispatch 2024-02-10T08:41:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:25 smithi040 bash[35794]: audit 2024-02-10T08:41:24.400939+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]': finished 2024-02-10T08:41:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:25 smithi145 bash[35820]: audit 2024-02-10T08:41:24.397280+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.40:0/2145316338' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]: dispatch 2024-02-10T08:41:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:25 smithi145 bash[35820]: audit 2024-02-10T08:41:24.397538+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]: dispatch 2024-02-10T08:41:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:25 smithi145 bash[35820]: audit 2024-02-10T08:41:24.400939+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1"}]': finished 2024-02-10T08:41:27.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:27 smithi040 bash[35794]: cluster 2024-02-10T08:41:26.272636+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:27.258 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:27 smithi040 bash[38951]: cluster 2024-02-10T08:41:26.272636+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:27 smithi145 bash[35820]: cluster 2024-02-10T08:41:26.272636+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:28 smithi145 bash[35820]: audit 2024-02-10T08:41:27.743196+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.40:0/4284139180' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:41:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:28 smithi145 bash[35820]: audit 2024-02-10T08:41:28.032585+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-10T08:41:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:28 smithi145 bash[35820]: audit 2024-02-10T08:41:28.033195+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:41:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:28 smithi145 bash[35820]: audit 2024-02-10T08:41:28.033806+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-10T08:41:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[35794]: audit 2024-02-10T08:41:27.743196+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.40:0/4284139180' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[35794]: audit 2024-02-10T08:41:28.032585+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[35794]: audit 2024-02-10T08:41:28.033195+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[35794]: audit 2024-02-10T08:41:28.033806+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[38951]: audit 2024-02-10T08:41:27.743196+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.40:0/4284139180' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[38951]: audit 2024-02-10T08:41:28.032585+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[38951]: audit 2024-02-10T08:41:28.033195+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:41:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:28 smithi040 bash[38951]: audit 2024-02-10T08:41:28.033806+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-10T08:41:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:29 smithi145 bash[35820]: audit 2024-02-10T08:41:28.031470+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "redeploy", "name": "mgr.x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:29 smithi145 bash[35820]: cephadm 2024-02-10T08:41:28.031831+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Redeploy daemons mgr.x 2024-02-10T08:41:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:29 smithi145 bash[35820]: cephadm 2024-02-10T08:41:28.033603+0000 mgr.y (mgr.14140) 351 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:41:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:29 smithi145 bash[35820]: cluster 2024-02-10T08:41:28.273171+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[35794]: audit 2024-02-10T08:41:28.031470+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "redeploy", "name": "mgr.x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[35794]: cephadm 2024-02-10T08:41:28.031831+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Redeploy daemons mgr.x 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[35794]: cephadm 2024-02-10T08:41:28.033603+0000 mgr.y (mgr.14140) 351 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[35794]: cluster 2024-02-10T08:41:28.273171+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[38951]: audit 2024-02-10T08:41:28.031470+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch daemon", "action": "redeploy", "name": "mgr.x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[38951]: cephadm 2024-02-10T08:41:28.031831+0000 mgr.y (mgr.14140) 350 : cephadm [INF] Redeploy daemons mgr.x 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[38951]: cephadm 2024-02-10T08:41:28.033603+0000 mgr.y (mgr.14140) 351 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:41:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:29 smithi040 bash[38951]: cluster 2024-02-10T08:41:28.273171+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:30 smithi040 bash[35794]: cluster 2024-02-10T08:41:30.273748+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:30.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:30 smithi040 bash[38951]: cluster 2024-02-10T08:41:30.273748+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:30 smithi145 bash[35820]: cluster 2024-02-10T08:41:30.273748+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:32 smithi040 bash[35794]: cluster 2024-02-10T08:41:32.274231+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:32 smithi040 bash[38951]: cluster 2024-02-10T08:41:32.274231+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:32 smithi145 bash[35820]: cluster 2024-02-10T08:41:32.274231+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:34 smithi040 bash[35794]: cluster 2024-02-10T08:41:34.274797+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:34 smithi040 bash[38951]: cluster 2024-02-10T08:41:34.274797+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:34 smithi145 bash[35820]: cluster 2024-02-10T08:41:34.274797+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:37 smithi145 bash[35820]: cluster 2024-02-10T08:41:36.275492+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:37 smithi040 bash[35794]: cluster 2024-02-10T08:41:36.275492+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:37.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:37 smithi040 bash[38951]: cluster 2024-02-10T08:41:36.275492+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:38.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:38 smithi040 bash[35794]: cluster 2024-02-10T08:41:38.276098+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:38.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:38 smithi040 bash[38951]: cluster 2024-02-10T08:41:38.276098+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:38 smithi145 bash[35820]: cluster 2024-02-10T08:41:38.276098+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:40 smithi040 bash[35794]: cluster 2024-02-10T08:41:40.276662+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:40 smithi040 bash[38951]: cluster 2024-02-10T08:41:40.276662+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:40 smithi145 bash[35820]: cluster 2024-02-10T08:41:40.276662+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:42 smithi040 bash[35794]: cluster 2024-02-10T08:41:42.277131+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:42 smithi040 bash[38951]: cluster 2024-02-10T08:41:42.277131+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:42 smithi145 bash[35820]: cluster 2024-02-10T08:41:42.277131+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:44.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:44 smithi040 bash[35794]: cluster 2024-02-10T08:41:44.277814+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:44 smithi040 bash[38951]: cluster 2024-02-10T08:41:44.277814+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:44 smithi145 bash[35820]: cluster 2024-02-10T08:41:44.277814+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:47.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:47 smithi145 bash[35820]: cluster 2024-02-10T08:41:46.278490+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:47 smithi040 bash[35794]: cluster 2024-02-10T08:41:46.278490+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:47 smithi040 bash[38951]: cluster 2024-02-10T08:41:46.278490+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:48 smithi040 bash[35794]: cluster 2024-02-10T08:41:48.279056+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:48.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:48 smithi040 bash[38951]: cluster 2024-02-10T08:41:48.279056+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:48 smithi145 bash[35820]: cluster 2024-02-10T08:41:48.279056+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:50.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:50 smithi040 bash[38951]: cluster 2024-02-10T08:41:50.279724+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:50.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:50 smithi040 bash[35794]: cluster 2024-02-10T08:41:50.279724+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:50 smithi145 bash[35820]: cluster 2024-02-10T08:41:50.279724+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:52 smithi040 bash[35794]: cluster 2024-02-10T08:41:52.280252+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:52.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:52 smithi040 bash[38951]: cluster 2024-02-10T08:41:52.280252+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:52 smithi145 bash[35820]: cluster 2024-02-10T08:41:52.280252+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:54.466 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:54 smithi145 bash[35820]: cluster 2024-02-10T08:41:54.280763+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:54 smithi040 bash[35794]: cluster 2024-02-10T08:41:54.280763+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:54.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:54 smithi040 bash[38951]: cluster 2024-02-10T08:41:54.280763+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:55.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:41:54 smithi145 systemd[1]: Stopping Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:41:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:57 smithi145 bash[35820]: cluster 2024-02-10T08:41:56.281430+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:57 smithi040 bash[35794]: cluster 2024-02-10T08:41:56.281430+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:57.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:57 smithi040 bash[38951]: cluster 2024-02-10T08:41:56.281430+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:41:58 smithi040 bash[35794]: cluster 2024-02-10T08:41:58.281951+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:58.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:41:58 smithi040 bash[38951]: cluster 2024-02-10T08:41:58.281951+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:41:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:41:58 smithi145 bash[35820]: cluster 2024-02-10T08:41:58.281951+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:00 smithi040 bash[35794]: cluster 2024-02-10T08:42:00.282714+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:00 smithi040 bash[38951]: cluster 2024-02-10T08:42:00.282714+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:00 smithi145 bash[35820]: cluster 2024-02-10T08:42:00.282714+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:02 smithi040 bash[35794]: cluster 2024-02-10T08:42:02.283406+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:02 smithi040 bash[38951]: cluster 2024-02-10T08:42:02.283406+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:02 smithi145 bash[35820]: cluster 2024-02-10T08:42:02.283406+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:04 smithi040 bash[35794]: cluster 2024-02-10T08:42:04.283992+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:04 smithi040 bash[38951]: cluster 2024-02-10T08:42:04.283992+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:04 smithi145 bash[35820]: cluster 2024-02-10T08:42:04.283992+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:05.263 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:04 smithi145 podman[48362]: time="2024-02-10T08:42:04Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x in 10 seconds, resorting to SIGKILL" 2024-02-10T08:42:05.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 podman[48362]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x 2024-02-10T08:42:05.924 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-10T08:42:05.924 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-10T08:42:05.924 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 systemd[1]: Stopped Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:42:05.924 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 systemd[1]: Starting Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:42:05.924 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 podman[48440]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x" found: no such container 2024-02-10T08:42:05.924 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:05 smithi145 systemd[1]: Started Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:42:06.090 INFO:teuthology.orchestra.run.smithi040.stdout:Deployed mgr.x on host 'smithi145' 2024-02-10T08:42:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:05 smithi040 bash[35794]: audit 2024-02-10T08:42:05.866642+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:05 smithi040 bash[35794]: audit 2024-02-10T08:42:05.870524+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:05 smithi040 bash[38951]: audit 2024-02-10T08:42:05.866642+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:05 smithi040 bash[38951]: audit 2024-02-10T08:42:05.870524+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:05 smithi145 bash[35820]: audit 2024-02-10T08:42:05.866642+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:05 smithi145 bash[35820]: audit 2024-02-10T08:42:05.870524+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782353\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782484\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782517\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782550\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782582\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782613\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782645\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782677\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:07.782708\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:06.601 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[48458]: debug 2024-02-10T08:42:06.390+0000 7ff26608c700 1 -- 172.21.15.145:0/808365490 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5597a64724e0 con 0x5597a6447000 2024-02-10T08:42:06.601 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[48458]: debug 2024-02-10T08:42:06.511+0000 7ff276688680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:42:06.928 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[48458]: debug 2024-02-10T08:42:06.599+0000 7ff276688680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:42:06.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps --refresh' 2024-02-10T08:42:07.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[48458]: debug 2024-02-10T08:42:06.980+0000 7ff276688680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:42:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[35820]: audit 2024-02-10T08:42:06.111951+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]: dispatch 2024-02-10T08:42:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[35820]: audit 2024-02-10T08:42:06.116762+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]': finished 2024-02-10T08:42:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[35820]: audit 2024-02-10T08:42:06.117453+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:06 smithi145 bash[35820]: cluster 2024-02-10T08:42:06.284455+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:07.408 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[35794]: audit 2024-02-10T08:42:06.111951+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]: dispatch 2024-02-10T08:42:07.408 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[35794]: audit 2024-02-10T08:42:06.116762+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]': finished 2024-02-10T08:42:07.409 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[35794]: audit 2024-02-10T08:42:06.117453+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:07.409 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[35794]: cluster 2024-02-10T08:42:06.284455+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:07.410 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[38951]: audit 2024-02-10T08:42:06.111951+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]: dispatch 2024-02-10T08:42:07.410 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[38951]: audit 2024-02-10T08:42:06.116762+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148501\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148582\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148616\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148646\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148676\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148705\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148734\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148763\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148792\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:38:04.148822\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:38:04.148900\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]': finished 2024-02-10T08:42:07.410 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[38951]: audit 2024-02-10T08:42:06.117453+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:07.410 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:06 smithi040 bash[38951]: cluster 2024-02-10T08:42:06.284455+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:08.012 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:07 smithi145 bash[48458]: debug 2024-02-10T08:42:07.752+0000 7ff276688680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:42:08.012 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:07 smithi145 bash[48458]: debug 2024-02-10T08:42:07.839+0000 7ff276688680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:42:08.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:08 smithi145 bash[48458]: debug 2024-02-10T08:42:08.059+0000 7ff276688680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:42:08.363 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:08 smithi040 bash[38951]: cluster 2024-02-10T08:42:08.284971+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:08 smithi040 bash[35794]: cluster 2024-02-10T08:42:08.284971+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:08.706 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:08 smithi145 bash[35820]: cluster 2024-02-10T08:42:08.284971+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:09.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.067+0000 7ff276688680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:42:09.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.196+0000 7ff276688680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:42:09.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[35820]: audit 2024-02-10T08:42:09.269820+0000 mgr.y (mgr.14140) 373 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:42:09.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[35820]: audit 2024-02-10T08:42:09.270363+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:09.588 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.285+0000 7ff276688680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:42:09.588 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.380+0000 7ff276688680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:42:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:09 smithi040 bash[35794]: audit 2024-02-10T08:42:09.269820+0000 mgr.y (mgr.14140) 373 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:42:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:09 smithi040 bash[35794]: audit 2024-02-10T08:42:09.270363+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:09 smithi040 bash[38951]: audit 2024-02-10T08:42:09.269820+0000 mgr.y (mgr.14140) 373 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:42:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:09 smithi040 bash[38951]: audit 2024-02-10T08:42:09.270363+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:09.866 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.586+0000 7ff276688680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:42:10.206 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.865+0000 7ff276688680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:42:10.206 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:09 smithi145 bash[48458]: debug 2024-02-10T08:42:09.976+0000 7ff276688680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:42:10.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:10 smithi145 bash[35820]: cluster 2024-02-10T08:42:10.285585+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:10 smithi040 bash[35794]: cluster 2024-02-10T08:42:10.285585+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:10.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:10 smithi040 bash[38951]: cluster 2024-02-10T08:42:10.285585+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:11.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:10 smithi145 bash[48458]: debug 2024-02-10T08:42:10.728+0000 7ff276688680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:42:11.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:10 smithi145 bash[48458]: debug 2024-02-10T08:42:10.811+0000 7ff276688680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:42:11.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:10 smithi145 bash[48458]: debug 2024-02-10T08:42:10.902+0000 7ff276688680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:42:11.341 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[48458]: debug 2024-02-10T08:42:11.074+0000 7ff276688680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:42:11.608 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[48458]: debug 2024-02-10T08:42:11.340+0000 7ff276688680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:42:11.608 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[48458]: debug 2024-02-10T08:42:11.472+0000 7ff276688680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:42:11.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[35820]: audit 2024-02-10T08:42:10.730301+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729152\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729226\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729259\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729288\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729316\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729344\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729371\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729398\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729426\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729454\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:10.729528\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:11.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[35820]: audit 2024-02-10T08:42:10.733971+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729152\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729226\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729259\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729288\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729316\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729344\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729371\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729398\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729426\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729454\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:10.729528\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:11.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:11 smithi040 bash[35794]: audit 2024-02-10T08:42:10.730301+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729152\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729226\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729259\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729288\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729316\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729344\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729371\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729398\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729426\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729454\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:10.729528\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:11.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:11 smithi040 bash[35794]: audit 2024-02-10T08:42:10.733971+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729152\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729226\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729259\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729288\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729316\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729344\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729371\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729398\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729426\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729454\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:10.729528\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:11 smithi040 bash[38951]: audit 2024-02-10T08:42:10.730301+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729152\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729226\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729259\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729288\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729316\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729344\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729371\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729398\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729426\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729454\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:10.729528\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:11 smithi040 bash[38951]: audit 2024-02-10T08:42:10.733971+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729152\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729226\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729259\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729288\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729316\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729344\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729371\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729398\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729426\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:10.729454\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:10.729528\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:11.862 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[48458]: debug 2024-02-10T08:42:11.606+0000 7ff276688680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:42:11.863 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[48458]: debug 2024-02-10T08:42:11.778+0000 7ff276688680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:42:12.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:42:11 smithi145 bash[48458]: debug 2024-02-10T08:42:11.861+0000 7ff276688680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:42:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: cluster 2024-02-10T08:42:11.865008+0000 mon.a (mon.0) 591 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:42:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: cluster 2024-02-10T08:42:11.865129+0000 mon.a (mon.0) 592 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: audit 2024-02-10T08:42:11.865574+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: audit 2024-02-10T08:42:11.865877+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: audit 2024-02-10T08:42:11.866845+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: audit 2024-02-10T08:42:11.867042+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[35794]: cluster 2024-02-10T08:42:12.286230+0000 mgr.y (mgr.14140) 375 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: cluster 2024-02-10T08:42:11.865008+0000 mon.a (mon.0) 591 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: cluster 2024-02-10T08:42:11.865129+0000 mon.a (mon.0) 592 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: audit 2024-02-10T08:42:11.865574+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: audit 2024-02-10T08:42:11.865877+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: audit 2024-02-10T08:42:11.866845+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:42:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: audit 2024-02-10T08:42:11.867042+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:42:12.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:12 smithi040 bash[38951]: cluster 2024-02-10T08:42:12.286230+0000 mgr.y (mgr.14140) 375 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: cluster 2024-02-10T08:42:11.865008+0000 mon.a (mon.0) 591 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: cluster 2024-02-10T08:42:11.865129+0000 mon.a (mon.0) 592 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: audit 2024-02-10T08:42:11.865574+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: audit 2024-02-10T08:42:11.865877+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: audit 2024-02-10T08:42:11.866845+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: audit 2024-02-10T08:42:11.867042+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:42:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:12 smithi145 bash[35820]: cluster 2024-02-10T08:42:12.286230+0000 mgr.y (mgr.14140) 375 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[35794]: cluster 2024-02-10T08:42:12.386736+0000 mon.a (mon.0) 593 : cluster [DBG] mgrmap e14: y(active, since 10m), standbys: x 2024-02-10T08:42:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[38951]: cluster 2024-02-10T08:42:12.386736+0000 mon.a (mon.0) 593 : cluster [DBG] mgrmap e14: y(active, since 10m), standbys: x 2024-02-10T08:42:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[35794]: audit 2024-02-10T08:42:12.601075+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599793\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599871\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599904\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599933\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599962\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599990\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600019\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600049\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600090\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600119\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:42:12.600199\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]: dispatch 2024-02-10T08:42:13.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[38951]: audit 2024-02-10T08:42:12.601075+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599793\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599871\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599904\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599933\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599962\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599990\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600019\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600049\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600090\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600119\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:42:12.600199\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]: dispatch 2024-02-10T08:42:13.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[35794]: audit 2024-02-10T08:42:12.604095+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599793\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599871\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599904\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599933\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599962\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599990\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600019\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600049\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600090\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600119\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:42:12.600199\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]': finished 2024-02-10T08:42:13.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[35794]: audit 2024-02-10T08:42:12.604617+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:13.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[38951]: audit 2024-02-10T08:42:12.604095+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599793\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599871\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599904\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599933\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599962\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599990\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600019\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600049\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600090\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600119\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:42:12.600199\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]': finished 2024-02-10T08:42:13.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:13 smithi040 bash[38951]: audit 2024-02-10T08:42:12.604617+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:13 smithi145 bash[35820]: cluster 2024-02-10T08:42:12.386736+0000 mon.a (mon.0) 593 : cluster [DBG] mgrmap e14: y(active, since 10m), standbys: x 2024-02-10T08:42:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:13 smithi145 bash[35820]: audit 2024-02-10T08:42:12.601075+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599793\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599871\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599904\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599933\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599962\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599990\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600019\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600049\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600090\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600119\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:42:12.600199\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]: dispatch 2024-02-10T08:42:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:13 smithi145 bash[35820]: audit 2024-02-10T08:42:12.604095+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599793\", \"created\": \"2024-02-10T08:30:59.049472\", \"started\": \"2024-02-10T08:31:04.212334\"}, \"mgr.y\": {\"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599871\", \"created\": \"2024-02-10T08:31:06.341381\", \"started\": \"2024-02-10T08:31:06.373777\"}, \"mon.c\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599904\", \"created\": \"2024-02-10T08:32:26.230367\", \"started\": \"2024-02-10T08:32:26.262906\"}, \"osd.0\": {\"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599933\", \"created\": \"2024-02-10T08:33:15.560734\", \"started\": \"2024-02-10T08:33:18.375011\"}, \"osd.1\": {\"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599962\", \"created\": \"2024-02-10T08:33:35.299480\", \"started\": \"2024-02-10T08:33:37.463127\"}, \"osd.2\": {\"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.599990\", \"created\": \"2024-02-10T08:33:55.493219\", \"started\": \"2024-02-10T08:34:00.121605\"}, \"osd.3\": {\"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600019\", \"created\": \"2024-02-10T08:34:15.851956\", \"started\": \"2024-02-10T08:34:18.741266\"}, \"node-exporter.a\": {\"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600049\", \"created\": \"2024-02-10T08:36:04.296557\", \"started\": \"2024-02-10T08:36:15.890238\"}, \"alertmanager.a\": {\"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600090\", \"created\": \"2024-02-10T08:36:23.300313\", \"started\": \"2024-02-10T08:36:57.786259\"}, \"rgw.r.z.smithi040.skjeib\": {\"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:12.600119\", \"created\": \"2024-02-10T08:37:59.058079\", \"started\": \"2024-02-10T08:37:59.273190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925\"}}, \"last_daemon_update\": \"2024-02-10T08:42:12.600199\", \"last_device_update\": \"2024-02-10T08:34:23.237900\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.40\"]}, \"last_host_check\": \"2024-02-10T08:42:06.111054\"}"}]': finished 2024-02-10T08:42:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:13 smithi145 bash[35820]: audit 2024-02-10T08:42:12.604617+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-10T08:42:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:14 smithi040 bash[35794]: cluster 2024-02-10T08:42:14.286877+0000 mgr.y (mgr.14140) 376 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:14 smithi040 bash[38951]: cluster 2024-02-10T08:42:14.286877+0000 mgr.y (mgr.14140) 376 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:14 smithi145 bash[35820]: cluster 2024-02-10T08:42:14.286877+0000 mgr.y (mgr.14140) 376 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:16.958 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (5m) 0s ago 5m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c def7846928ea 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (11s) 0s ago 9m 16.2.14-521-g0e714d9a quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 1fbc92c859dc b9b23ff414a1 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (9m) 0s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (6m) 0s ago 6m docker.io/prom/node-exporter:latest 72c9c2088986 b3a2408fef6b 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (7m) 0s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (7m) 0s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (7m) 0s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (5m) 0s ago 6m docker.io/prom/prometheus:latest 2a72b385beaf 2da2a296a6e5 2024-02-10T08:42:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (4m) 0s ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:42:17.379 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:17 smithi040 bash[38951]: cluster 2024-02-10T08:42:16.287501+0000 mgr.y (mgr.14140) 377 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:17.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:17 smithi040 bash[35794]: cluster 2024-02-10T08:42:16.287501+0000 mgr.y (mgr.14140) 377 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:17.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:17 smithi040 bash[35794]: audit 2024-02-10T08:42:16.951940+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950530\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950624\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950662\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950694\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950725\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950757\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950787\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950819\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950850\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950882\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:16.950975\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:17.380 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:17 smithi040 bash[35794]: audit 2024-02-10T08:42:16.955555+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950530\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950624\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950662\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950694\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950725\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950757\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950787\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950819\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950850\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950882\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:16.950975\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:17.380 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:17 smithi040 bash[38951]: audit 2024-02-10T08:42:16.951940+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950530\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950624\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950662\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950694\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950725\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950757\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950787\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950819\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950850\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950882\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:16.950975\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:17.380 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:17 smithi040 bash[38951]: audit 2024-02-10T08:42:16.955555+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950530\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950624\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950662\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950694\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950725\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950757\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950787\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950819\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950850\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950882\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:16.950975\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:17 smithi145 bash[35820]: cluster 2024-02-10T08:42:16.287501+0000 mgr.y (mgr.14140) 377 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:17 smithi145 bash[35820]: audit 2024-02-10T08:42:16.951940+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950530\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950624\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950662\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950694\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950725\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950757\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950787\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950819\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950850\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950882\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:16.950975\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]: dispatch 2024-02-10T08:42:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:17 smithi145 bash[35820]: audit 2024-02-10T08:42:16.955555+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.15.40:0/3315567461' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950530\", \"created\": \"2024-02-10T08:32:39.006939\", \"started\": \"2024-02-10T08:32:39.037264\"}, \"mgr.x\": {\"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950624\", \"created\": \"2024-02-10T08:32:58.437528\", \"started\": \"2024-02-10T08:42:05.865471\"}, \"osd.4\": {\"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950662\", \"created\": \"2024-02-10T08:34:32.248539\", \"started\": \"2024-02-10T08:34:34.689979\"}, \"osd.5\": {\"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950694\", \"created\": \"2024-02-10T08:34:52.119116\", \"started\": \"2024-02-10T08:34:55.852345\"}, \"osd.6\": {\"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950725\", \"created\": \"2024-02-10T08:35:11.424706\", \"started\": \"2024-02-10T08:35:14.017865\"}, \"osd.7\": {\"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950757\", \"created\": \"2024-02-10T08:35:30.858292\", \"started\": \"2024-02-10T08:35:33.238367\"}, \"prometheus.a\": {\"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950787\", \"created\": \"2024-02-10T08:35:59.812676\", \"started\": \"2024-02-10T08:37:02.161579\"}, \"node-exporter.b\": {\"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950819\", \"created\": \"2024-02-10T08:36:03.384600\", \"started\": \"2024-02-10T08:36:12.247921\"}, \"grafana.a\": {\"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950850\", \"created\": \"2024-02-10T08:36:40.854802\", \"started\": \"2024-02-10T08:36:40.964204\"}, \"rgw.r.z.smithi145.uizklq\": {\"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-10T08:42:16.950882\", \"created\": \"2024-02-10T08:38:00.979091\", \"started\": \"2024-02-10T08:38:01.010487\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513\"}}, \"last_daemon_update\": \"2024-02-10T08:42:16.950975\", \"last_device_update\": \"2024-02-10T08:35:37.228807\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.145\"]}, \"last_host_check\": \"2024-02-10T08:32:12.277666\"}"}]': finished 2024-02-10T08:42:17.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 180' 2024-02-10T08:42:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:18 smithi040 bash[35794]: cluster 2024-02-10T08:42:18.288081+0000 mgr.y (mgr.14140) 378 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:18.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:18 smithi040 bash[38951]: cluster 2024-02-10T08:42:18.288081+0000 mgr.y (mgr.14140) 378 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:18 smithi145 bash[35820]: cluster 2024-02-10T08:42:18.288081+0000 mgr.y (mgr.14140) 378 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:20 smithi040 bash[35794]: cluster 2024-02-10T08:42:20.288776+0000 mgr.y (mgr.14140) 379 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:20.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:20 smithi040 bash[38951]: cluster 2024-02-10T08:42:20.288776+0000 mgr.y (mgr.14140) 379 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:20 smithi145 bash[35820]: cluster 2024-02-10T08:42:20.288776+0000 mgr.y (mgr.14140) 379 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:22.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:22 smithi040 bash[35794]: cluster 2024-02-10T08:42:22.289357+0000 mgr.y (mgr.14140) 380 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:22 smithi040 bash[38951]: cluster 2024-02-10T08:42:22.289357+0000 mgr.y (mgr.14140) 380 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:22 smithi145 bash[35820]: cluster 2024-02-10T08:42:22.289357+0000 mgr.y (mgr.14140) 380 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:24.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:24 smithi040 bash[35794]: cluster 2024-02-10T08:42:24.289876+0000 mgr.y (mgr.14140) 381 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:24 smithi040 bash[38951]: cluster 2024-02-10T08:42:24.289876+0000 mgr.y (mgr.14140) 381 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:24 smithi145 bash[35820]: cluster 2024-02-10T08:42:24.289876+0000 mgr.y (mgr.14140) 381 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:27 smithi145 bash[35820]: cluster 2024-02-10T08:42:26.290332+0000 mgr.y (mgr.14140) 382 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:27 smithi040 bash[35794]: cluster 2024-02-10T08:42:26.290332+0000 mgr.y (mgr.14140) 382 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:27.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:27 smithi040 bash[38951]: cluster 2024-02-10T08:42:26.290332+0000 mgr.y (mgr.14140) 382 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:28 smithi040 bash[35794]: cluster 2024-02-10T08:42:28.290949+0000 mgr.y (mgr.14140) 383 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:28.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:28 smithi040 bash[38951]: cluster 2024-02-10T08:42:28.290949+0000 mgr.y (mgr.14140) 383 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:28 smithi145 bash[35820]: cluster 2024-02-10T08:42:28.290949+0000 mgr.y (mgr.14140) 383 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:30 smithi040 bash[35794]: cluster 2024-02-10T08:42:30.291595+0000 mgr.y (mgr.14140) 384 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:30.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:30 smithi040 bash[38951]: cluster 2024-02-10T08:42:30.291595+0000 mgr.y (mgr.14140) 384 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:30 smithi145 bash[35820]: cluster 2024-02-10T08:42:30.291595+0000 mgr.y (mgr.14140) 384 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:32 smithi040 bash[35794]: cluster 2024-02-10T08:42:32.292034+0000 mgr.y (mgr.14140) 385 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:32 smithi040 bash[38951]: cluster 2024-02-10T08:42:32.292034+0000 mgr.y (mgr.14140) 385 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:32 smithi145 bash[35820]: cluster 2024-02-10T08:42:32.292034+0000 mgr.y (mgr.14140) 385 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:34 smithi040 bash[35794]: cluster 2024-02-10T08:42:34.292703+0000 mgr.y (mgr.14140) 386 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:34.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:34 smithi040 bash[38951]: cluster 2024-02-10T08:42:34.292703+0000 mgr.y (mgr.14140) 386 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:34 smithi145 bash[35820]: cluster 2024-02-10T08:42:34.292703+0000 mgr.y (mgr.14140) 386 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:37 smithi145 bash[35820]: cluster 2024-02-10T08:42:36.293286+0000 mgr.y (mgr.14140) 387 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:37 smithi040 bash[35794]: cluster 2024-02-10T08:42:36.293286+0000 mgr.y (mgr.14140) 387 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:37 smithi040 bash[38951]: cluster 2024-02-10T08:42:36.293286+0000 mgr.y (mgr.14140) 387 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:38.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:38 smithi040 bash[35794]: cluster 2024-02-10T08:42:38.293956+0000 mgr.y (mgr.14140) 388 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:38.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:38 smithi040 bash[38951]: cluster 2024-02-10T08:42:38.293956+0000 mgr.y (mgr.14140) 388 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:38 smithi145 bash[35820]: cluster 2024-02-10T08:42:38.293956+0000 mgr.y (mgr.14140) 388 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:40 smithi040 bash[35794]: cluster 2024-02-10T08:42:40.294469+0000 mgr.y (mgr.14140) 389 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:40 smithi040 bash[38951]: cluster 2024-02-10T08:42:40.294469+0000 mgr.y (mgr.14140) 389 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:40 smithi145 bash[35820]: cluster 2024-02-10T08:42:40.294469+0000 mgr.y (mgr.14140) 389 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:42 smithi040 bash[35794]: cluster 2024-02-10T08:42:42.294892+0000 mgr.y (mgr.14140) 390 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:42.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:42 smithi040 bash[38951]: cluster 2024-02-10T08:42:42.294892+0000 mgr.y (mgr.14140) 390 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:42 smithi145 bash[35820]: cluster 2024-02-10T08:42:42.294892+0000 mgr.y (mgr.14140) 390 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:44 smithi040 bash[35794]: cluster 2024-02-10T08:42:44.295477+0000 mgr.y (mgr.14140) 391 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:44 smithi040 bash[38951]: cluster 2024-02-10T08:42:44.295477+0000 mgr.y (mgr.14140) 391 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:44 smithi145 bash[35820]: cluster 2024-02-10T08:42:44.295477+0000 mgr.y (mgr.14140) 391 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:47 smithi145 bash[35820]: cluster 2024-02-10T08:42:46.296167+0000 mgr.y (mgr.14140) 392 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:47 smithi040 bash[35794]: cluster 2024-02-10T08:42:46.296167+0000 mgr.y (mgr.14140) 392 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:47 smithi040 bash[38951]: cluster 2024-02-10T08:42:46.296167+0000 mgr.y (mgr.14140) 392 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:48 smithi040 bash[35794]: cluster 2024-02-10T08:42:48.296655+0000 mgr.y (mgr.14140) 393 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:48 smithi040 bash[38951]: cluster 2024-02-10T08:42:48.296655+0000 mgr.y (mgr.14140) 393 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:48 smithi145 bash[35820]: cluster 2024-02-10T08:42:48.296655+0000 mgr.y (mgr.14140) 393 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:50 smithi040 bash[35794]: cluster 2024-02-10T08:42:50.297280+0000 mgr.y (mgr.14140) 394 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:50 smithi040 bash[38951]: cluster 2024-02-10T08:42:50.297280+0000 mgr.y (mgr.14140) 394 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:50 smithi145 bash[35820]: cluster 2024-02-10T08:42:50.297280+0000 mgr.y (mgr.14140) 394 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:52 smithi040 bash[35794]: cluster 2024-02-10T08:42:52.297771+0000 mgr.y (mgr.14140) 395 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:52.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:52 smithi040 bash[38951]: cluster 2024-02-10T08:42:52.297771+0000 mgr.y (mgr.14140) 395 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:52 smithi145 bash[35820]: cluster 2024-02-10T08:42:52.297771+0000 mgr.y (mgr.14140) 395 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:54 smithi040 bash[35794]: cluster 2024-02-10T08:42:54.298347+0000 mgr.y (mgr.14140) 396 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:54.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:54 smithi040 bash[38951]: cluster 2024-02-10T08:42:54.298347+0000 mgr.y (mgr.14140) 396 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:54 smithi145 bash[35820]: cluster 2024-02-10T08:42:54.298347+0000 mgr.y (mgr.14140) 396 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:57 smithi145 bash[35820]: cluster 2024-02-10T08:42:56.298912+0000 mgr.y (mgr.14140) 397 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:57 smithi040 bash[35794]: cluster 2024-02-10T08:42:56.298912+0000 mgr.y (mgr.14140) 397 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:57.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:57 smithi040 bash[38951]: cluster 2024-02-10T08:42:56.298912+0000 mgr.y (mgr.14140) 397 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:42:58 smithi040 bash[35794]: cluster 2024-02-10T08:42:58.299446+0000 mgr.y (mgr.14140) 398 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:58.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:42:58 smithi040 bash[38951]: cluster 2024-02-10T08:42:58.299446+0000 mgr.y (mgr.14140) 398 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:42:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:42:58 smithi145 bash[35820]: cluster 2024-02-10T08:42:58.299446+0000 mgr.y (mgr.14140) 398 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:00 smithi040 bash[35794]: cluster 2024-02-10T08:43:00.300291+0000 mgr.y (mgr.14140) 399 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:00 smithi040 bash[38951]: cluster 2024-02-10T08:43:00.300291+0000 mgr.y (mgr.14140) 399 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:00 smithi145 bash[35820]: cluster 2024-02-10T08:43:00.300291+0000 mgr.y (mgr.14140) 399 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:02 smithi040 bash[35794]: cluster 2024-02-10T08:43:02.300922+0000 mgr.y (mgr.14140) 400 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:02.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:02 smithi040 bash[38951]: cluster 2024-02-10T08:43:02.300922+0000 mgr.y (mgr.14140) 400 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:02 smithi145 bash[35820]: cluster 2024-02-10T08:43:02.300922+0000 mgr.y (mgr.14140) 400 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:04 smithi040 bash[35794]: cluster 2024-02-10T08:43:04.301494+0000 mgr.y (mgr.14140) 401 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:04 smithi040 bash[38951]: cluster 2024-02-10T08:43:04.301494+0000 mgr.y (mgr.14140) 401 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:04 smithi145 bash[35820]: cluster 2024-02-10T08:43:04.301494+0000 mgr.y (mgr.14140) 401 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:07 smithi145 bash[35820]: cluster 2024-02-10T08:43:06.301990+0000 mgr.y (mgr.14140) 402 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:07 smithi040 bash[35794]: cluster 2024-02-10T08:43:06.301990+0000 mgr.y (mgr.14140) 402 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:07 smithi040 bash[38951]: cluster 2024-02-10T08:43:06.301990+0000 mgr.y (mgr.14140) 402 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:08 smithi040 bash[35794]: cluster 2024-02-10T08:43:08.302492+0000 mgr.y (mgr.14140) 403 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:08 smithi040 bash[38951]: cluster 2024-02-10T08:43:08.302492+0000 mgr.y (mgr.14140) 403 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:08 smithi145 bash[35820]: cluster 2024-02-10T08:43:08.302492+0000 mgr.y (mgr.14140) 403 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:10 smithi040 bash[35794]: cluster 2024-02-10T08:43:10.303093+0000 mgr.y (mgr.14140) 404 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:10 smithi040 bash[38951]: cluster 2024-02-10T08:43:10.303093+0000 mgr.y (mgr.14140) 404 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:10 smithi145 bash[35820]: cluster 2024-02-10T08:43:10.303093+0000 mgr.y (mgr.14140) 404 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:12 smithi040 bash[35794]: cluster 2024-02-10T08:43:12.303623+0000 mgr.y (mgr.14140) 405 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:12 smithi040 bash[38951]: cluster 2024-02-10T08:43:12.303623+0000 mgr.y (mgr.14140) 405 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:12 smithi145 bash[35820]: cluster 2024-02-10T08:43:12.303623+0000 mgr.y (mgr.14140) 405 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:14 smithi040 bash[35794]: cluster 2024-02-10T08:43:14.304245+0000 mgr.y (mgr.14140) 406 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:14 smithi040 bash[38951]: cluster 2024-02-10T08:43:14.304245+0000 mgr.y (mgr.14140) 406 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:14 smithi145 bash[35820]: cluster 2024-02-10T08:43:14.304245+0000 mgr.y (mgr.14140) 406 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:17 smithi145 bash[35820]: cluster 2024-02-10T08:43:16.304793+0000 mgr.y (mgr.14140) 407 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:17 smithi040 bash[35794]: cluster 2024-02-10T08:43:16.304793+0000 mgr.y (mgr.14140) 407 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:17 smithi040 bash[38951]: cluster 2024-02-10T08:43:16.304793+0000 mgr.y (mgr.14140) 407 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:18 smithi040 bash[35794]: cluster 2024-02-10T08:43:18.305377+0000 mgr.y (mgr.14140) 408 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:18 smithi040 bash[38951]: cluster 2024-02-10T08:43:18.305377+0000 mgr.y (mgr.14140) 408 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:18 smithi145 bash[35820]: cluster 2024-02-10T08:43:18.305377+0000 mgr.y (mgr.14140) 408 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:20 smithi040 bash[35794]: cluster 2024-02-10T08:43:20.306095+0000 mgr.y (mgr.14140) 409 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:20.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:20 smithi040 bash[38951]: cluster 2024-02-10T08:43:20.306095+0000 mgr.y (mgr.14140) 409 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:20 smithi145 bash[35820]: cluster 2024-02-10T08:43:20.306095+0000 mgr.y (mgr.14140) 409 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:22 smithi040 bash[35794]: cluster 2024-02-10T08:43:22.306683+0000 mgr.y (mgr.14140) 410 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:22.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:22 smithi040 bash[38951]: cluster 2024-02-10T08:43:22.306683+0000 mgr.y (mgr.14140) 410 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:22 smithi145 bash[35820]: cluster 2024-02-10T08:43:22.306683+0000 mgr.y (mgr.14140) 410 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:24.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:24 smithi040 bash[35794]: cluster 2024-02-10T08:43:24.307260+0000 mgr.y (mgr.14140) 411 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:24 smithi040 bash[38951]: cluster 2024-02-10T08:43:24.307260+0000 mgr.y (mgr.14140) 411 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:24 smithi145 bash[35820]: cluster 2024-02-10T08:43:24.307260+0000 mgr.y (mgr.14140) 411 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:27 smithi145 bash[35820]: cluster 2024-02-10T08:43:26.307794+0000 mgr.y (mgr.14140) 412 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:27 smithi040 bash[35794]: cluster 2024-02-10T08:43:26.307794+0000 mgr.y (mgr.14140) 412 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:27.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:27 smithi040 bash[38951]: cluster 2024-02-10T08:43:26.307794+0000 mgr.y (mgr.14140) 412 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:28 smithi040 bash[35794]: cluster 2024-02-10T08:43:28.308408+0000 mgr.y (mgr.14140) 413 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:28 smithi040 bash[38951]: cluster 2024-02-10T08:43:28.308408+0000 mgr.y (mgr.14140) 413 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:28 smithi145 bash[35820]: cluster 2024-02-10T08:43:28.308408+0000 mgr.y (mgr.14140) 413 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:30 smithi040 bash[35794]: cluster 2024-02-10T08:43:30.308967+0000 mgr.y (mgr.14140) 414 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:30.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:30 smithi040 bash[38951]: cluster 2024-02-10T08:43:30.308967+0000 mgr.y (mgr.14140) 414 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:30 smithi145 bash[35820]: cluster 2024-02-10T08:43:30.308967+0000 mgr.y (mgr.14140) 414 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:32 smithi040 bash[35794]: cluster 2024-02-10T08:43:32.309447+0000 mgr.y (mgr.14140) 415 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:32 smithi040 bash[38951]: cluster 2024-02-10T08:43:32.309447+0000 mgr.y (mgr.14140) 415 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:32 smithi145 bash[35820]: cluster 2024-02-10T08:43:32.309447+0000 mgr.y (mgr.14140) 415 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:34 smithi040 bash[35794]: cluster 2024-02-10T08:43:34.310148+0000 mgr.y (mgr.14140) 416 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:34 smithi040 bash[38951]: cluster 2024-02-10T08:43:34.310148+0000 mgr.y (mgr.14140) 416 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:34 smithi145 bash[35820]: cluster 2024-02-10T08:43:34.310148+0000 mgr.y (mgr.14140) 416 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:37 smithi145 bash[35820]: cluster 2024-02-10T08:43:36.310602+0000 mgr.y (mgr.14140) 417 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:37 smithi040 bash[35794]: cluster 2024-02-10T08:43:36.310602+0000 mgr.y (mgr.14140) 417 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:37.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:37 smithi040 bash[38951]: cluster 2024-02-10T08:43:36.310602+0000 mgr.y (mgr.14140) 417 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:38.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:38 smithi040 bash[35794]: cluster 2024-02-10T08:43:38.311225+0000 mgr.y (mgr.14140) 418 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:38.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:38 smithi040 bash[38951]: cluster 2024-02-10T08:43:38.311225+0000 mgr.y (mgr.14140) 418 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:38 smithi145 bash[35820]: cluster 2024-02-10T08:43:38.311225+0000 mgr.y (mgr.14140) 418 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:40 smithi040 bash[35794]: cluster 2024-02-10T08:43:40.311756+0000 mgr.y (mgr.14140) 419 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:40 smithi040 bash[38951]: cluster 2024-02-10T08:43:40.311756+0000 mgr.y (mgr.14140) 419 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:40 smithi145 bash[35820]: cluster 2024-02-10T08:43:40.311756+0000 mgr.y (mgr.14140) 419 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:42 smithi040 bash[35794]: cluster 2024-02-10T08:43:42.312234+0000 mgr.y (mgr.14140) 420 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:42.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:42 smithi040 bash[38951]: cluster 2024-02-10T08:43:42.312234+0000 mgr.y (mgr.14140) 420 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:42 smithi145 bash[35820]: cluster 2024-02-10T08:43:42.312234+0000 mgr.y (mgr.14140) 420 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:44 smithi040 bash[35794]: cluster 2024-02-10T08:43:44.312776+0000 mgr.y (mgr.14140) 421 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:44.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:44 smithi040 bash[38951]: cluster 2024-02-10T08:43:44.312776+0000 mgr.y (mgr.14140) 421 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:44 smithi145 bash[35820]: cluster 2024-02-10T08:43:44.312776+0000 mgr.y (mgr.14140) 421 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:47 smithi145 bash[35820]: cluster 2024-02-10T08:43:46.313376+0000 mgr.y (mgr.14140) 422 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:47 smithi040 bash[35794]: cluster 2024-02-10T08:43:46.313376+0000 mgr.y (mgr.14140) 422 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:47.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:47 smithi040 bash[38951]: cluster 2024-02-10T08:43:46.313376+0000 mgr.y (mgr.14140) 422 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:48 smithi040 bash[35794]: cluster 2024-02-10T08:43:48.313919+0000 mgr.y (mgr.14140) 423 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:48 smithi040 bash[38951]: cluster 2024-02-10T08:43:48.313919+0000 mgr.y (mgr.14140) 423 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:48 smithi145 bash[35820]: cluster 2024-02-10T08:43:48.313919+0000 mgr.y (mgr.14140) 423 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:50 smithi040 bash[35794]: cluster 2024-02-10T08:43:50.314499+0000 mgr.y (mgr.14140) 424 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:50.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:50 smithi040 bash[38951]: cluster 2024-02-10T08:43:50.314499+0000 mgr.y (mgr.14140) 424 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:50 smithi145 bash[35820]: cluster 2024-02-10T08:43:50.314499+0000 mgr.y (mgr.14140) 424 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:52 smithi040 bash[35794]: cluster 2024-02-10T08:43:52.315096+0000 mgr.y (mgr.14140) 425 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:52.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:52 smithi040 bash[38951]: cluster 2024-02-10T08:43:52.315096+0000 mgr.y (mgr.14140) 425 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:52 smithi145 bash[35820]: cluster 2024-02-10T08:43:52.315096+0000 mgr.y (mgr.14140) 425 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:54 smithi040 bash[35794]: cluster 2024-02-10T08:43:54.315673+0000 mgr.y (mgr.14140) 426 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:54.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:54 smithi040 bash[38951]: cluster 2024-02-10T08:43:54.315673+0000 mgr.y (mgr.14140) 426 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:54 smithi145 bash[35820]: cluster 2024-02-10T08:43:54.315673+0000 mgr.y (mgr.14140) 426 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:57 smithi145 bash[35820]: cluster 2024-02-10T08:43:56.316408+0000 mgr.y (mgr.14140) 427 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:57 smithi040 bash[35794]: cluster 2024-02-10T08:43:56.316408+0000 mgr.y (mgr.14140) 427 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:57 smithi040 bash[38951]: cluster 2024-02-10T08:43:56.316408+0000 mgr.y (mgr.14140) 427 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:43:58 smithi040 bash[35794]: cluster 2024-02-10T08:43:58.316846+0000 mgr.y (mgr.14140) 428 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:58.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:43:58 smithi040 bash[38951]: cluster 2024-02-10T08:43:58.316846+0000 mgr.y (mgr.14140) 428 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:43:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:43:58 smithi145 bash[35820]: cluster 2024-02-10T08:43:58.316846+0000 mgr.y (mgr.14140) 428 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:00 smithi040 bash[35794]: cluster 2024-02-10T08:44:00.317534+0000 mgr.y (mgr.14140) 429 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:00.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:00 smithi040 bash[38951]: cluster 2024-02-10T08:44:00.317534+0000 mgr.y (mgr.14140) 429 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:00 smithi145 bash[35820]: cluster 2024-02-10T08:44:00.317534+0000 mgr.y (mgr.14140) 429 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:02 smithi040 bash[35794]: cluster 2024-02-10T08:44:02.318027+0000 mgr.y (mgr.14140) 430 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:02.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:02 smithi040 bash[38951]: cluster 2024-02-10T08:44:02.318027+0000 mgr.y (mgr.14140) 430 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:02 smithi145 bash[35820]: cluster 2024-02-10T08:44:02.318027+0000 mgr.y (mgr.14140) 430 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:04 smithi040 bash[35794]: cluster 2024-02-10T08:44:04.318577+0000 mgr.y (mgr.14140) 431 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:04 smithi040 bash[38951]: cluster 2024-02-10T08:44:04.318577+0000 mgr.y (mgr.14140) 431 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:04 smithi145 bash[35820]: cluster 2024-02-10T08:44:04.318577+0000 mgr.y (mgr.14140) 431 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:07 smithi145 bash[35820]: cluster 2024-02-10T08:44:06.319090+0000 mgr.y (mgr.14140) 432 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:07 smithi040 bash[35794]: cluster 2024-02-10T08:44:06.319090+0000 mgr.y (mgr.14140) 432 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:07 smithi040 bash[38951]: cluster 2024-02-10T08:44:06.319090+0000 mgr.y (mgr.14140) 432 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:08 smithi040 bash[35794]: cluster 2024-02-10T08:44:08.319607+0000 mgr.y (mgr.14140) 433 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:08 smithi040 bash[38951]: cluster 2024-02-10T08:44:08.319607+0000 mgr.y (mgr.14140) 433 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:08 smithi145 bash[35820]: cluster 2024-02-10T08:44:08.319607+0000 mgr.y (mgr.14140) 433 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:10 smithi040 bash[35794]: cluster 2024-02-10T08:44:10.320292+0000 mgr.y (mgr.14140) 434 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:10 smithi040 bash[38951]: cluster 2024-02-10T08:44:10.320292+0000 mgr.y (mgr.14140) 434 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:10 smithi145 bash[35820]: cluster 2024-02-10T08:44:10.320292+0000 mgr.y (mgr.14140) 434 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:12 smithi040 bash[35794]: cluster 2024-02-10T08:44:12.321012+0000 mgr.y (mgr.14140) 435 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:12 smithi040 bash[38951]: cluster 2024-02-10T08:44:12.321012+0000 mgr.y (mgr.14140) 435 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:12 smithi145 bash[35820]: cluster 2024-02-10T08:44:12.321012+0000 mgr.y (mgr.14140) 435 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:14 smithi040 bash[35794]: cluster 2024-02-10T08:44:14.321785+0000 mgr.y (mgr.14140) 436 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:14 smithi040 bash[38951]: cluster 2024-02-10T08:44:14.321785+0000 mgr.y (mgr.14140) 436 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:14 smithi145 bash[35820]: cluster 2024-02-10T08:44:14.321785+0000 mgr.y (mgr.14140) 436 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:17 smithi145 bash[35820]: cluster 2024-02-10T08:44:16.322296+0000 mgr.y (mgr.14140) 437 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:17 smithi040 bash[35794]: cluster 2024-02-10T08:44:16.322296+0000 mgr.y (mgr.14140) 437 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:17 smithi040 bash[38951]: cluster 2024-02-10T08:44:16.322296+0000 mgr.y (mgr.14140) 437 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:18 smithi040 bash[35794]: cluster 2024-02-10T08:44:18.322807+0000 mgr.y (mgr.14140) 438 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:18.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:18 smithi040 bash[38951]: cluster 2024-02-10T08:44:18.322807+0000 mgr.y (mgr.14140) 438 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:18 smithi145 bash[35820]: cluster 2024-02-10T08:44:18.322807+0000 mgr.y (mgr.14140) 438 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:20 smithi040 bash[35794]: cluster 2024-02-10T08:44:20.323393+0000 mgr.y (mgr.14140) 439 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:20.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:20 smithi040 bash[38951]: cluster 2024-02-10T08:44:20.323393+0000 mgr.y (mgr.14140) 439 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:20 smithi145 bash[35820]: cluster 2024-02-10T08:44:20.323393+0000 mgr.y (mgr.14140) 439 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:22 smithi040 bash[35794]: cluster 2024-02-10T08:44:22.323989+0000 mgr.y (mgr.14140) 440 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:22.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:22 smithi040 bash[38951]: cluster 2024-02-10T08:44:22.323989+0000 mgr.y (mgr.14140) 440 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:22 smithi145 bash[35820]: cluster 2024-02-10T08:44:22.323989+0000 mgr.y (mgr.14140) 440 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:24.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:24 smithi040 bash[35794]: cluster 2024-02-10T08:44:24.324613+0000 mgr.y (mgr.14140) 441 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:24.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:24 smithi040 bash[38951]: cluster 2024-02-10T08:44:24.324613+0000 mgr.y (mgr.14140) 441 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:24 smithi145 bash[35820]: cluster 2024-02-10T08:44:24.324613+0000 mgr.y (mgr.14140) 441 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:27 smithi145 bash[35820]: cluster 2024-02-10T08:44:26.325142+0000 mgr.y (mgr.14140) 442 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:27 smithi040 bash[35794]: cluster 2024-02-10T08:44:26.325142+0000 mgr.y (mgr.14140) 442 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:27 smithi040 bash[38951]: cluster 2024-02-10T08:44:26.325142+0000 mgr.y (mgr.14140) 442 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:28.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:28 smithi040 bash[35794]: cluster 2024-02-10T08:44:28.325675+0000 mgr.y (mgr.14140) 443 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:28 smithi040 bash[38951]: cluster 2024-02-10T08:44:28.325675+0000 mgr.y (mgr.14140) 443 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:28 smithi145 bash[35820]: cluster 2024-02-10T08:44:28.325675+0000 mgr.y (mgr.14140) 443 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:30.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:30 smithi040 bash[35794]: cluster 2024-02-10T08:44:30.326309+0000 mgr.y (mgr.14140) 444 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:30.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:30 smithi040 bash[38951]: cluster 2024-02-10T08:44:30.326309+0000 mgr.y (mgr.14140) 444 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:30 smithi145 bash[35820]: cluster 2024-02-10T08:44:30.326309+0000 mgr.y (mgr.14140) 444 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:32 smithi040 bash[35794]: cluster 2024-02-10T08:44:32.326969+0000 mgr.y (mgr.14140) 445 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:32 smithi040 bash[38951]: cluster 2024-02-10T08:44:32.326969+0000 mgr.y (mgr.14140) 445 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:32 smithi145 bash[35820]: cluster 2024-02-10T08:44:32.326969+0000 mgr.y (mgr.14140) 445 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:34 smithi040 bash[35794]: cluster 2024-02-10T08:44:34.327627+0000 mgr.y (mgr.14140) 446 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:34 smithi040 bash[38951]: cluster 2024-02-10T08:44:34.327627+0000 mgr.y (mgr.14140) 446 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:34 smithi145 bash[35820]: cluster 2024-02-10T08:44:34.327627+0000 mgr.y (mgr.14140) 446 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:37 smithi145 bash[35820]: cluster 2024-02-10T08:44:36.328128+0000 mgr.y (mgr.14140) 447 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:37 smithi040 bash[35794]: cluster 2024-02-10T08:44:36.328128+0000 mgr.y (mgr.14140) 447 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:37.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:37 smithi040 bash[38951]: cluster 2024-02-10T08:44:36.328128+0000 mgr.y (mgr.14140) 447 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:38.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:38 smithi040 bash[35794]: cluster 2024-02-10T08:44:38.328825+0000 mgr.y (mgr.14140) 448 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:38.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:38 smithi040 bash[38951]: cluster 2024-02-10T08:44:38.328825+0000 mgr.y (mgr.14140) 448 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:38 smithi145 bash[35820]: cluster 2024-02-10T08:44:38.328825+0000 mgr.y (mgr.14140) 448 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:40 smithi040 bash[35794]: cluster 2024-02-10T08:44:40.329556+0000 mgr.y (mgr.14140) 449 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:40.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:40 smithi040 bash[38951]: cluster 2024-02-10T08:44:40.329556+0000 mgr.y (mgr.14140) 449 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:40 smithi145 bash[35820]: cluster 2024-02-10T08:44:40.329556+0000 mgr.y (mgr.14140) 449 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:42 smithi040 bash[35794]: cluster 2024-02-10T08:44:42.330052+0000 mgr.y (mgr.14140) 450 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:42 smithi040 bash[38951]: cluster 2024-02-10T08:44:42.330052+0000 mgr.y (mgr.14140) 450 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:42 smithi145 bash[35820]: cluster 2024-02-10T08:44:42.330052+0000 mgr.y (mgr.14140) 450 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:44 smithi040 bash[35794]: cluster 2024-02-10T08:44:44.330646+0000 mgr.y (mgr.14140) 451 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:44.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:44 smithi040 bash[38951]: cluster 2024-02-10T08:44:44.330646+0000 mgr.y (mgr.14140) 451 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:44 smithi145 bash[35820]: cluster 2024-02-10T08:44:44.330646+0000 mgr.y (mgr.14140) 451 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:47 smithi145 bash[35820]: cluster 2024-02-10T08:44:46.331144+0000 mgr.y (mgr.14140) 452 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:47 smithi040 bash[35794]: cluster 2024-02-10T08:44:46.331144+0000 mgr.y (mgr.14140) 452 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:47.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:47 smithi040 bash[38951]: cluster 2024-02-10T08:44:46.331144+0000 mgr.y (mgr.14140) 452 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:48 smithi040 bash[35794]: cluster 2024-02-10T08:44:48.331675+0000 mgr.y (mgr.14140) 453 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:48.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:48 smithi040 bash[38951]: cluster 2024-02-10T08:44:48.331675+0000 mgr.y (mgr.14140) 453 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:48 smithi145 bash[35820]: cluster 2024-02-10T08:44:48.331675+0000 mgr.y (mgr.14140) 453 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:50.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:50 smithi040 bash[35794]: cluster 2024-02-10T08:44:50.332281+0000 mgr.y (mgr.14140) 454 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:50.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:50 smithi040 bash[38951]: cluster 2024-02-10T08:44:50.332281+0000 mgr.y (mgr.14140) 454 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:50 smithi145 bash[35820]: cluster 2024-02-10T08:44:50.332281+0000 mgr.y (mgr.14140) 454 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:52 smithi040 bash[35794]: cluster 2024-02-10T08:44:52.332771+0000 mgr.y (mgr.14140) 455 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:52 smithi040 bash[38951]: cluster 2024-02-10T08:44:52.332771+0000 mgr.y (mgr.14140) 455 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:52 smithi145 bash[35820]: cluster 2024-02-10T08:44:52.332771+0000 mgr.y (mgr.14140) 455 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:54.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:54 smithi040 bash[35794]: cluster 2024-02-10T08:44:54.333460+0000 mgr.y (mgr.14140) 456 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:54.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:54 smithi040 bash[38951]: cluster 2024-02-10T08:44:54.333460+0000 mgr.y (mgr.14140) 456 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:54 smithi145 bash[35820]: cluster 2024-02-10T08:44:54.333460+0000 mgr.y (mgr.14140) 456 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:57 smithi145 bash[35820]: cluster 2024-02-10T08:44:56.333956+0000 mgr.y (mgr.14140) 457 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:57 smithi040 bash[35794]: cluster 2024-02-10T08:44:56.333956+0000 mgr.y (mgr.14140) 457 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:57.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:57 smithi040 bash[38951]: cluster 2024-02-10T08:44:56.333956+0000 mgr.y (mgr.14140) 457 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:44:58 smithi040 bash[35794]: cluster 2024-02-10T08:44:58.334454+0000 mgr.y (mgr.14140) 458 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:58.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:44:58 smithi040 bash[38951]: cluster 2024-02-10T08:44:58.334454+0000 mgr.y (mgr.14140) 458 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:44:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:44:58 smithi145 bash[35820]: cluster 2024-02-10T08:44:58.334454+0000 mgr.y (mgr.14140) 458 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:00 smithi040 bash[35794]: cluster 2024-02-10T08:45:00.335196+0000 mgr.y (mgr.14140) 459 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:00.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:00 smithi040 bash[38951]: cluster 2024-02-10T08:45:00.335196+0000 mgr.y (mgr.14140) 459 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:00 smithi145 bash[35820]: cluster 2024-02-10T08:45:00.335196+0000 mgr.y (mgr.14140) 459 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:02 smithi040 bash[35794]: cluster 2024-02-10T08:45:02.335815+0000 mgr.y (mgr.14140) 460 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:02.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:02 smithi040 bash[38951]: cluster 2024-02-10T08:45:02.335815+0000 mgr.y (mgr.14140) 460 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:02.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:02 smithi145 bash[35820]: cluster 2024-02-10T08:45:02.335815+0000 mgr.y (mgr.14140) 460 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:04 smithi040 bash[35794]: cluster 2024-02-10T08:45:04.336637+0000 mgr.y (mgr.14140) 461 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:04 smithi040 bash[38951]: cluster 2024-02-10T08:45:04.336637+0000 mgr.y (mgr.14140) 461 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:04 smithi145 bash[35820]: cluster 2024-02-10T08:45:04.336637+0000 mgr.y (mgr.14140) 461 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:07 smithi145 bash[35820]: cluster 2024-02-10T08:45:06.337259+0000 mgr.y (mgr.14140) 462 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:07 smithi040 bash[35794]: cluster 2024-02-10T08:45:06.337259+0000 mgr.y (mgr.14140) 462 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:07 smithi040 bash[38951]: cluster 2024-02-10T08:45:06.337259+0000 mgr.y (mgr.14140) 462 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:08 smithi040 bash[35794]: cluster 2024-02-10T08:45:08.337876+0000 mgr.y (mgr.14140) 463 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:08 smithi040 bash[38951]: cluster 2024-02-10T08:45:08.337876+0000 mgr.y (mgr.14140) 463 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:08 smithi145 bash[35820]: cluster 2024-02-10T08:45:08.337876+0000 mgr.y (mgr.14140) 463 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:10 smithi040 bash[35794]: cluster 2024-02-10T08:45:10.338693+0000 mgr.y (mgr.14140) 464 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:10 smithi040 bash[38951]: cluster 2024-02-10T08:45:10.338693+0000 mgr.y (mgr.14140) 464 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:10 smithi145 bash[35820]: cluster 2024-02-10T08:45:10.338693+0000 mgr.y (mgr.14140) 464 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:13 smithi040 bash[35794]: cluster 2024-02-10T08:45:12.339380+0000 mgr.y (mgr.14140) 465 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:13 smithi040 bash[38951]: cluster 2024-02-10T08:45:12.339380+0000 mgr.y (mgr.14140) 465 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:13 smithi145 bash[35820]: cluster 2024-02-10T08:45:12.339380+0000 mgr.y (mgr.14140) 465 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:15 smithi040 bash[35794]: cluster 2024-02-10T08:45:14.339923+0000 mgr.y (mgr.14140) 466 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:15 smithi040 bash[38951]: cluster 2024-02-10T08:45:14.339923+0000 mgr.y (mgr.14140) 466 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:15 smithi145 bash[35820]: cluster 2024-02-10T08:45:14.339923+0000 mgr.y (mgr.14140) 466 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:18 smithi145 bash[35820]: cluster 2024-02-10T08:45:16.340406+0000 mgr.y (mgr.14140) 467 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:18 smithi040 bash[35794]: cluster 2024-02-10T08:45:16.340406+0000 mgr.y (mgr.14140) 467 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:18.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:18 smithi040 bash[38951]: cluster 2024-02-10T08:45:16.340406+0000 mgr.y (mgr.14140) 467 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:20.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:20 smithi145 bash[35820]: cluster 2024-02-10T08:45:18.340941+0000 mgr.y (mgr.14140) 468 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:20.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:20 smithi040 bash[35794]: cluster 2024-02-10T08:45:18.340941+0000 mgr.y (mgr.14140) 468 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:20.655 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:20 smithi040 bash[38951]: cluster 2024-02-10T08:45:18.340941+0000 mgr.y (mgr.14140) 468 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:20.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T08:45:22.346 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:22 smithi040 bash[35794]: cluster 2024-02-10T08:45:20.341521+0000 mgr.y (mgr.14140) 469 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:22.346 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:22 smithi040 bash[38951]: cluster 2024-02-10T08:45:20.341521+0000 mgr.y (mgr.14140) 469 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:22.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:22 smithi145 bash[35820]: cluster 2024-02-10T08:45:20.341521+0000 mgr.y (mgr.14140) 469 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:23.089 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (8m) 3m ago 8m docker.io/prom/alertmanager:latest 9f27df16978d 058a51d56bd4 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (8m) 3m ago 8m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c def7846928ea 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (3m) 3m ago 12m 16.2.14-521-g0e714d9a quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 1fbc92c859dc b9b23ff414a1 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (14m) 3m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e1e38dadb5ff 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (14m) 3m ago 14m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (12m) 3m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (12m) 3m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (9m) 3m ago 9m docker.io/prom/node-exporter:latest 72c9c2088986 499f0f53e04a 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (9m) 3m ago 9m docker.io/prom/node-exporter:latest 72c9c2088986 b3a2408fef6b 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (12m) 3m ago 12m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (11m) 3m ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:45:23.090 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:45:23.091 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:45:23.091 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (8m) 3m ago 9m docker.io/prom/prometheus:latest 2a72b385beaf 2da2a296a6e5 2024-02-10T08:45:23.091 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:45:23.091 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:45:24.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T08:45:24.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:24 smithi040 bash[35794]: cluster 2024-02-10T08:45:22.342004+0000 mgr.y (mgr.14140) 470 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:24.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:24 smithi040 bash[35794]: audit 2024-02-10T08:45:23.085979+0000 mgr.y (mgr.14140) 471 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:45:24.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:24 smithi040 bash[38951]: cluster 2024-02-10T08:45:22.342004+0000 mgr.y (mgr.14140) 470 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:24.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:24 smithi040 bash[38951]: audit 2024-02-10T08:45:23.085979+0000 mgr.y (mgr.14140) 471 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:45:24.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:24 smithi145 bash[35820]: cluster 2024-02-10T08:45:22.342004+0000 mgr.y (mgr.14140) 470 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:24.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:24 smithi145 bash[35820]: audit 2024-02-10T08:45:23.085979+0000 mgr.y (mgr.14140) 471 : audit [DBG] from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:45:26.346 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:45:26.346 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:45:26.346 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:45:26.347 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:45:26.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:26 smithi145 bash[35820]: cluster 2024-02-10T08:45:24.342510+0000 mgr.y (mgr.14140) 472 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:26.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:26 smithi040 bash[35794]: cluster 2024-02-10T08:45:24.342510+0000 mgr.y (mgr.14140) 472 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:26.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:26 smithi040 bash[38951]: cluster 2024-02-10T08:45:24.342510+0000 mgr.y (mgr.14140) 472 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:27.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph -s' 2024-02-10T08:45:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:27 smithi145 bash[35820]: audit 2024-02-10T08:45:26.346369+0000 mon.a (mon.0) 599 : audit [DBG] from='client.? 172.21.15.40:0/1000903846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:45:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:27 smithi040 bash[35794]: audit 2024-02-10T08:45:26.346369+0000 mon.a (mon.0) 599 : audit [DBG] from='client.? 172.21.15.40:0/1000903846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:45:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:27 smithi040 bash[38951]: audit 2024-02-10T08:45:26.346369+0000 mon.a (mon.0) 599 : audit [DBG] from='client.? 172.21.15.40:0/1000903846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:45:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:28 smithi145 bash[35820]: cluster 2024-02-10T08:45:26.342932+0000 mgr.y (mgr.14140) 473 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:28.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:28 smithi040 bash[35794]: cluster 2024-02-10T08:45:26.342932+0000 mgr.y (mgr.14140) 473 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:28.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:28 smithi040 bash[38951]: cluster 2024-02-10T08:45:26.342932+0000 mgr.y (mgr.14140) 473 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:29.580 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-10T08:45:29.580 INFO:teuthology.orchestra.run.smithi040.stdout: id: a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:45:29.580 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-10T08:45:29.580 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:45:29.580 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-10T08:45:29.580 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 12m) 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: y(active, since 13m), standbys: x 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.skjeib, r.z.smithi145.uizklq) 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 5 pools, 129 pgs 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.0 KiB 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 129 active+clean 2024-02-10T08:45:29.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:45:30.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:30 smithi040 bash[35794]: cluster 2024-02-10T08:45:28.343518+0000 mgr.y (mgr.14140) 474 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:30.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:30 smithi040 bash[35794]: audit 2024-02-10T08:45:29.580270+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.15.40:0/167713052' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:45:30.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:30 smithi040 bash[38951]: cluster 2024-02-10T08:45:28.343518+0000 mgr.y (mgr.14140) 474 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:30.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:30 smithi040 bash[38951]: audit 2024-02-10T08:45:29.580270+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.15.40:0/167713052' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:45:30.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:30 smithi145 bash[35820]: cluster 2024-02-10T08:45:28.343518+0000 mgr.y (mgr.14140) 474 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:30.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:30 smithi145 bash[35820]: audit 2024-02-10T08:45:29.580270+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.15.40:0/167713052' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:45:30.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 2'"'"'' 2024-02-10T08:45:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:32 smithi145 bash[35820]: cluster 2024-02-10T08:45:30.344111+0000 mgr.y (mgr.14140) 475 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:32.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:32 smithi040 bash[35794]: cluster 2024-02-10T08:45:30.344111+0000 mgr.y (mgr.14140) 475 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:32.594 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:32 smithi040 bash[38951]: cluster 2024-02-10T08:45:30.344111+0000 mgr.y (mgr.14140) 475 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T08:45:33.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:33 smithi040 bash[35794]: audit 2024-02-10T08:45:33.064300+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.40:0/3396397989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:45:33.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:33 smithi040 bash[38951]: audit 2024-02-10T08:45:33.064300+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.40:0/3396397989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:45:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:33 smithi145 bash[35820]: audit 2024-02-10T08:45:33.064300+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.40:0/3396397989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:45:33.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph mgr fail' 2024-02-10T08:45:34.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:34 smithi040 bash[38951]: cluster 2024-02-10T08:45:32.344539+0000 mgr.y (mgr.14140) 476 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:34.602 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:34 smithi040 bash[35794]: cluster 2024-02-10T08:45:32.344539+0000 mgr.y (mgr.14140) 476 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:34 smithi145 bash[35820]: cluster 2024-02-10T08:45:32.344539+0000 mgr.y (mgr.14140) 476 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[35794]: cluster 2024-02-10T08:45:34.345240+0000 mgr.y (mgr.14140) 477 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[35794]: audit 2024-02-10T08:45:36.109482+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.40:0/1377250952' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:45:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[35794]: audit 2024-02-10T08:45:36.109772+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:45:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[35794]: cluster 2024-02-10T08:45:36.113104+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-10T08:45:36.676 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[36026]: debug 2024-02-10T08:45:36.286+0000 7fb8af3e1700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-10T08:45:36.677 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[36026]: ignoring --setuser ceph since I am not root 2024-02-10T08:45:36.677 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[36026]: ignoring --setgroup ceph since I am not root 2024-02-10T08:45:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[38951]: cluster 2024-02-10T08:45:34.345240+0000 mgr.y (mgr.14140) 477 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[38951]: audit 2024-02-10T08:45:36.109482+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.40:0/1377250952' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:45:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[38951]: audit 2024-02-10T08:45:36.109772+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:45:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:36 smithi040 bash[38951]: cluster 2024-02-10T08:45:36.113104+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-10T08:45:36.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:36 smithi145 bash[35820]: cluster 2024-02-10T08:45:34.345240+0000 mgr.y (mgr.14140) 477 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:36.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:36 smithi145 bash[35820]: audit 2024-02-10T08:45:36.109482+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.40:0/1377250952' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:45:36.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:36 smithi145 bash[35820]: audit 2024-02-10T08:45:36.109772+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:45:36.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:36 smithi145 bash[35820]: cluster 2024-02-10T08:45:36.113104+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-10T08:45:37.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 180' 2024-02-10T08:45:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:37 smithi040 bash[35794]: audit 2024-02-10T08:45:36.288280+0000 mon.a (mon.0) 602 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:45:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:37 smithi040 bash[35794]: cluster 2024-02-10T08:45:36.288337+0000 mon.a (mon.0) 603 : cluster [DBG] mgrmap e15: x(active, starting, since 0.178151s) 2024-02-10T08:45:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:37 smithi040 bash[38951]: audit 2024-02-10T08:45:36.288280+0000 mon.a (mon.0) 602 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:45:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:37 smithi040 bash[38951]: cluster 2024-02-10T08:45:36.288337+0000 mon.a (mon.0) 603 : cluster [DBG] mgrmap e15: x(active, starting, since 0.178151s) 2024-02-10T08:45:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:37 smithi145 bash[35820]: audit 2024-02-10T08:45:36.288280+0000 mon.a (mon.0) 602 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:45:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:37 smithi145 bash[35820]: cluster 2024-02-10T08:45:36.288337+0000 mon.a (mon.0) 603 : cluster [DBG] mgrmap e15: x(active, starting, since 0.178151s) 2024-02-10T08:45:38.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:38 smithi040 bash[35794]: cluster 2024-02-10T08:45:37.301604+0000 mon.a (mon.0) 604 : cluster [DBG] mgrmap e16: x(active, starting, since 1.19142s) 2024-02-10T08:45:38.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:38 smithi040 bash[35794]: audit 2024-02-10T08:45:37.302231+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:45:38.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:38 smithi040 bash[38951]: cluster 2024-02-10T08:45:37.301604+0000 mon.a (mon.0) 604 : cluster [DBG] mgrmap e16: x(active, starting, since 1.19142s) 2024-02-10T08:45:38.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:38 smithi040 bash[38951]: audit 2024-02-10T08:45:37.302231+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:45:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:38 smithi145 bash[35820]: cluster 2024-02-10T08:45:37.301604+0000 mon.a (mon.0) 604 : cluster [DBG] mgrmap e16: x(active, starting, since 1.19142s) 2024-02-10T08:45:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:38 smithi145 bash[35820]: audit 2024-02-10T08:45:37.302231+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:45:40.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:40 smithi145 bash[35820]: cluster 2024-02-10T08:45:40.160336+0000 mon.a (mon.0) 605 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:45:40.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:40 smithi145 bash[35820]: audit 2024-02-10T08:45:40.160724+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.40:0/953796567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:45:40.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:40 smithi145 bash[35820]: audit 2024-02-10T08:45:40.161790+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.? 172.21.15.40:0/953796567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:45:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:40 smithi040 bash[35794]: cluster 2024-02-10T08:45:40.160336+0000 mon.a (mon.0) 605 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:45:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:40 smithi040 bash[35794]: audit 2024-02-10T08:45:40.160724+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.40:0/953796567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:45:40.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:40 smithi040 bash[35794]: audit 2024-02-10T08:45:40.161790+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.? 172.21.15.40:0/953796567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:45:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:40 smithi040 bash[38951]: cluster 2024-02-10T08:45:40.160336+0000 mon.a (mon.0) 605 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:45:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:40 smithi040 bash[38951]: audit 2024-02-10T08:45:40.160724+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.40:0/953796567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:45:40.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:40 smithi040 bash[38951]: audit 2024-02-10T08:45:40.161790+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.? 172.21.15.40:0/953796567' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:45:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:41 smithi145 bash[35820]: cluster 2024-02-10T08:45:40.215966+0000 mon.a (mon.0) 606 : cluster [DBG] mgrmap e17: x(active, starting, since 4s), standbys: y 2024-02-10T08:45:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:41 smithi145 bash[35820]: audit 2024-02-10T08:45:40.219725+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:45:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:41 smithi040 bash[35794]: cluster 2024-02-10T08:45:40.215966+0000 mon.a (mon.0) 606 : cluster [DBG] mgrmap e17: x(active, starting, since 4s), standbys: y 2024-02-10T08:45:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:41 smithi040 bash[35794]: audit 2024-02-10T08:45:40.219725+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:45:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:41 smithi040 bash[38951]: cluster 2024-02-10T08:45:40.215966+0000 mon.a (mon.0) 606 : cluster [DBG] mgrmap e17: x(active, starting, since 4s), standbys: y 2024-02-10T08:45:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:41 smithi040 bash[38951]: audit 2024-02-10T08:45:40.219725+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:45:42.595 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[48458]: Warning: Permanently added '172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-10T08:45:42.596 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[48458]: Warning: Permanently added 'smithi145,172.21.15.145' (ECDSA) to the list of known hosts. 2024-02-10T08:45:42.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.291180+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:45:42.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.291449+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:45:42.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.291643+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:45:42.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.293070+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:45:42.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.293354+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.293580+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.293810+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.294029+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.294249+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.294482+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.294715+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.295710+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.295963+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.296464+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.297232+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.298064+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.298404+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.298729+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.299064+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:45:42.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.299403+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.299700+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.300018+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.300303+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.300626+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.300915+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.301217+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.301520+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.301856+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.302149+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.302474+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.302777+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.303071+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.303370+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.303656+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:45:42.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: audit 2024-02-10T08:45:42.303922+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:45:42.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:42 smithi145 bash[35820]: cluster 2024-02-10T08:45:42.331295+0000 mon.a (mon.0) 607 : cluster [INF] Manager daemon x is now available 2024-02-10T08:45:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.291180+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:45:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.291449+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.291643+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.293070+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.293354+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.293580+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.293810+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.294029+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.294249+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.294482+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.294715+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.295710+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.295963+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.296464+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.297232+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.298064+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:45:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.298404+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.298729+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.291180+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.291449+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.291643+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.293070+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.293354+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.293580+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.293810+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.294029+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.294249+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.294482+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.294715+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:45:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.295710+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.295963+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.296464+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.297232+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.298064+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.298404+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.298729+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.299064+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.299403+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.299700+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:45:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.300018+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.300303+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.300626+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.300915+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.301217+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.301520+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.301856+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.302149+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.302474+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.302777+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.303071+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.303370+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.303656+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: audit 2024-02-10T08:45:42.303922+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:45:42.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[35794]: cluster 2024-02-10T08:45:42.331295+0000 mon.a (mon.0) 607 : cluster [INF] Manager daemon x is now available 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.299064+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.299403+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.299700+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.300018+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.300303+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.300626+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.300915+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.301217+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.301520+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.301856+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.302149+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.302474+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.302777+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:45:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.303071+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:45:42.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.303370+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:45:42.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.303656+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:45:42.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: audit 2024-02-10T08:45:42.303922+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:45:42.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:42 smithi040 bash[38951]: cluster 2024-02-10T08:45:42.331295+0000 mon.a (mon.0) 607 : cluster [INF] Manager daemon x is now available 2024-02-10T08:45:43.663 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: cephadm 2024-02-10T08:45:42.345083+0000 mgr.x (mgr.34640) 1 : cephadm [INF] inventory: adjusted host smithi040 addr 'smithi040' -> '172.21.15.40' 2024-02-10T08:45:43.663 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.348638+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:45:43.663 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.349367+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:45:43.663 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.352332+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:45:43.663 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: cephadm 2024-02-10T08:45:42.358895+0000 mgr.x (mgr.34640) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.359196+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.359615+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.362930+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: cluster 2024-02-10T08:45:42.389924+0000 mon.a (mon.0) 612 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: cluster 2024-02-10T08:45:42.395251+0000 mgr.x (mgr.34640) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.457301+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.457866+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: cephadm 2024-02-10T08:45:42.345083+0000 mgr.x (mgr.34640) 1 : cephadm [INF] inventory: adjusted host smithi040 addr 'smithi040' -> '172.21.15.40' 2024-02-10T08:45:43.664 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.348638+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.349367+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.352332+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: cephadm 2024-02-10T08:45:42.358895+0000 mgr.x (mgr.34640) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.359196+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.359615+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.362930+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: cluster 2024-02-10T08:45:42.389924+0000 mon.a (mon.0) 612 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: cluster 2024-02-10T08:45:42.395251+0000 mgr.x (mgr.34640) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.457301+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.457866+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.461008+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-10T08:45:43.665 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.462119+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.505197+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.505547+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.509014+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.509344+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:42.682644+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.461008+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.462119+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.505197+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:45:43.666 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.505547+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:45:43.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.509014+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:45:43.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.509344+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:45:43.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:42.682644+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:45:43.667 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:43.112402+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:43.667 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:43.112402+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:43.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:43.112989+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:43.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:43.115869+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:43.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[35794]: audit 2024-02-10T08:45:43.116945+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:45:43.668 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:43.112989+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:43.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:43.115869+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:43.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:43 smithi040 bash[38951]: audit 2024-02-10T08:45:43.116945+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: cephadm 2024-02-10T08:45:42.345083+0000 mgr.x (mgr.34640) 1 : cephadm [INF] inventory: adjusted host smithi040 addr 'smithi040' -> '172.21.15.40' 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.348638+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.349367+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.352332+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"smithi145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: cephadm 2024-02-10T08:45:42.358895+0000 mgr.x (mgr.34640) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.359196+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.359615+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-10T08:45:43.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.362930+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: cluster 2024-02-10T08:45:42.389924+0000 mon.a (mon.0) 612 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: cluster 2024-02-10T08:45:42.395251+0000 mgr.x (mgr.34640) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.457301+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.457866+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.461008+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.462119+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.505197+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.505547+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.509014+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.509344+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:42.682644+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:43.112402+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:43.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:43.112989+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:43.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:43.115869+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950530Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950624Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950662Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950694Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950725Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950757Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950787Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950819Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950850Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:42:16.950882Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:43.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:43 smithi145 bash[35820]: audit 2024-02-10T08:45:43.116945+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:45:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:44 smithi145 bash[35820]: cluster 2024-02-10T08:45:43.464789+0000 mon.a (mon.0) 619 : cluster [DBG] mgrmap e19: x(active, since 7s), standbys: y 2024-02-10T08:45:44.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:44 smithi145 bash[35820]: cluster 2024-02-10T08:45:44.295904+0000 mgr.x (mgr.34640) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:44 smithi040 bash[35794]: cluster 2024-02-10T08:45:43.464789+0000 mon.a (mon.0) 619 : cluster [DBG] mgrmap e19: x(active, since 7s), standbys: y 2024-02-10T08:45:44.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:44 smithi040 bash[35794]: cluster 2024-02-10T08:45:44.295904+0000 mgr.x (mgr.34640) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:44 smithi040 bash[38951]: cluster 2024-02-10T08:45:43.464789+0000 mon.a (mon.0) 619 : cluster [DBG] mgrmap e19: x(active, since 7s), standbys: y 2024-02-10T08:45:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:44 smithi040 bash[38951]: cluster 2024-02-10T08:45:44.295904+0000 mgr.x (mgr.34640) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:47 smithi040 bash[35794]: cluster 2024-02-10T08:45:46.296468+0000 mgr.x (mgr.34640) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:47 smithi040 bash[38951]: cluster 2024-02-10T08:45:46.296468+0000 mgr.x (mgr.34640) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:47.517 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:47 smithi145 bash[35820]: cluster 2024-02-10T08:45:46.296468+0000 mgr.x (mgr.34640) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:48.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.443383+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:48.355 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.444057+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.446953+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.777998+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.778375+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.778650+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.778916+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.779195+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.779451+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.779709+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.779940+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.356 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:48 smithi145 bash[35820]: audit 2024-02-10T08:45:47.780183+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.443383+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:48.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.443383+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:48.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.444057+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:48.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.444057+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:48.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.446953+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:48.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.777998+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.778375+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.778650+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.778916+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.779195+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.779451+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.779709+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.779940+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[35794]: audit 2024-02-10T08:45:47.780183+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.446953+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.777998+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.778375+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.778650+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.778916+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.779195+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.779451+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.779709+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:48.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.779940+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:48.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:48 smithi040 bash[38951]: audit 2024-02-10T08:45:47.780183+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.497 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: cluster 2024-02-10T08:45:48.297073+0000 mgr.x (mgr.34640) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:49.497 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: cluster 2024-02-10T08:45:48.297073+0000 mgr.x (mgr.34640) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:49.497 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:48.736756+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:49.498 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:48.736756+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:49.498 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:48.737537+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:48.737537+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:48.741114+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.042110+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.042447+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.042724+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.042934+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.043143+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.043349+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.043556+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.043773+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.043983+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.045035+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.045433+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.048975+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.051994+0000 mon.b (mon.2) 92 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.052506+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.052938+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:45:49.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[35794]: audit 2024-02-10T08:45:49.053644+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:48.741114+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.042110+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.042447+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.042724+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.042934+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.043143+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.043349+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.043556+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.043773+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.043983+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.045035+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.045433+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:45:49.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.048975+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:45:49.502 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.051994+0000 mon.b (mon.2) 92 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:45:49.502 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.052506+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:45:49.502 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.052938+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:45:49.502 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:49 smithi040 bash[38951]: audit 2024-02-10T08:45:49.053644+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T08:45:49.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: cluster 2024-02-10T08:45:48.297073+0000 mgr.x (mgr.34640) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:49.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:48.736756+0000 mon.b (mon.2) 81 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:49.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:48.737537+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:49.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:48.741114+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:36.057292Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.042110+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.042447+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.042724+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.042934+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.043143+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.043349+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.043556+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.043773+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.043983+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.045035+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.045433+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.048975+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.051994+0000 mon.b (mon.2) 92 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.052506+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:45:49.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.052938+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:45:49.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:49 smithi145 bash[35820]: audit 2024-02-10T08:45:49.053644+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T08:45:50.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:50 smithi040 bash[35794]: cephadm 2024-02-10T08:45:49.051753+0000 mgr.x (mgr.34640) 7 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-10T08:45:50.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:50 smithi040 bash[35794]: cephadm 2024-02-10T08:45:49.053372+0000 mgr.x (mgr.34640) 8 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-10T08:45:50.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:50 smithi040 bash[38951]: cephadm 2024-02-10T08:45:49.051753+0000 mgr.x (mgr.34640) 7 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-10T08:45:50.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:50 smithi040 bash[38951]: cephadm 2024-02-10T08:45:49.053372+0000 mgr.x (mgr.34640) 8 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-10T08:45:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:50 smithi145 bash[35820]: cephadm 2024-02-10T08:45:49.051753+0000 mgr.x (mgr.34640) 7 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-10T08:45:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:50 smithi145 bash[35820]: cephadm 2024-02-10T08:45:49.053372+0000 mgr.x (mgr.34640) 8 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: cluster 2024-02-10T08:45:50.297466+0000 mgr.x (mgr.34640) 9 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.496557+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.497496+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.500972+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.502726+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.503449+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.504141+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:45:51.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:51 smithi145 bash[35820]: audit 2024-02-10T08:45:50.505133+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T08:45:51.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: cluster 2024-02-10T08:45:50.297466+0000 mgr.x (mgr.34640) 9 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: cluster 2024-02-10T08:45:50.297466+0000 mgr.x (mgr.34640) 9 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:51.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.496557+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.496557+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.497496+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.500972+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.502726+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.503449+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.504141+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[35794]: audit 2024-02-10T08:45:50.505133+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T08:45:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.497496+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:45:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.500972+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:23.060708Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:45:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.502726+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:45:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.503449+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:45:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.504141+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:45:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:51 smithi040 bash[38951]: audit 2024-02-10T08:45:50.505133+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T08:45:52.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[35794]: cephadm 2024-02-10T08:45:50.502474+0000 mgr.x (mgr.34640) 10 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T08:45:52.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[35794]: cephadm 2024-02-10T08:45:50.504735+0000 mgr.x (mgr.34640) 11 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-10T08:45:52.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[38951]: cephadm 2024-02-10T08:45:50.502474+0000 mgr.x (mgr.34640) 10 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T08:45:52.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[38951]: cephadm 2024-02-10T08:45:50.504735+0000 mgr.x (mgr.34640) 11 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-10T08:45:52.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[35794]: audit 2024-02-10T08:45:52.120721+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:45:52.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[38951]: audit 2024-02-10T08:45:52.120721+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:45:52.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[35794]: audit 2024-02-10T08:45:52.121533+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:45:52.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[35794]: audit 2024-02-10T08:45:52.125705+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:45:52.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[38951]: audit 2024-02-10T08:45:52.121533+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:45:52.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:52 smithi040 bash[38951]: audit 2024-02-10T08:45:52.125705+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:45:52.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:52 smithi145 bash[35820]: cephadm 2024-02-10T08:45:50.502474+0000 mgr.x (mgr.34640) 10 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T08:45:52.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:52 smithi145 bash[35820]: cephadm 2024-02-10T08:45:50.504735+0000 mgr.x (mgr.34640) 11 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-10T08:45:52.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:52 smithi145 bash[35820]: audit 2024-02-10T08:45:52.120721+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:45:52.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:52 smithi145 bash[35820]: audit 2024-02-10T08:45:52.121533+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:45:52.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:52 smithi145 bash[35820]: audit 2024-02-10T08:45:52.125705+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"058a51d56bd4\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 23571988, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442122Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:36:57.786259Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-10T08:36:50.363708Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:47.442289Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:45:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:53 smithi145 bash[35820]: cephadm 2024-02-10T08:45:52.127054+0000 mgr.x (mgr.34640) 12 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:45:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:53 smithi145 bash[35820]: cephadm 2024-02-10T08:45:52.137916+0000 mgr.x (mgr.34640) 13 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-10T08:45:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:53 smithi145 bash[35820]: cluster 2024-02-10T08:45:52.297889+0000 mgr.x (mgr.34640) 14 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:53 smithi040 bash[35794]: cephadm 2024-02-10T08:45:52.127054+0000 mgr.x (mgr.34640) 12 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:45:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:53 smithi040 bash[35794]: cephadm 2024-02-10T08:45:52.137916+0000 mgr.x (mgr.34640) 13 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-10T08:45:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:53 smithi040 bash[35794]: cluster 2024-02-10T08:45:52.297889+0000 mgr.x (mgr.34640) 14 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:53 smithi040 bash[38951]: cephadm 2024-02-10T08:45:52.127054+0000 mgr.x (mgr.34640) 12 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-10T08:45:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:53 smithi040 bash[38951]: cephadm 2024-02-10T08:45:52.137916+0000 mgr.x (mgr.34640) 13 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi040 2024-02-10T08:45:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:53 smithi040 bash[38951]: cluster 2024-02-10T08:45:52.297889+0000 mgr.x (mgr.34640) 14 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:55 smithi040 bash[35794]: cluster 2024-02-10T08:45:54.298646+0000 mgr.x (mgr.34640) 15 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:55.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:55 smithi040 bash[38951]: cluster 2024-02-10T08:45:54.298646+0000 mgr.x (mgr.34640) 15 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:55 smithi145 bash[35820]: cluster 2024-02-10T08:45:54.298646+0000 mgr.x (mgr.34640) 15 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:57.454 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:57 smithi040 bash[35794]: cluster 2024-02-10T08:45:56.299110+0000 mgr.x (mgr.34640) 16 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:57.454 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:57 smithi040 bash[38951]: cluster 2024-02-10T08:45:56.299110+0000 mgr.x (mgr.34640) 16 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:57 smithi145 bash[35820]: cluster 2024-02-10T08:45:56.299110+0000 mgr.x (mgr.34640) 16 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:59.633 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:45:59 smithi040 bash[35794]: cluster 2024-02-10T08:45:58.299858+0000 mgr.x (mgr.34640) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:59.633 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:45:59 smithi040 bash[38951]: cluster 2024-02-10T08:45:58.299858+0000 mgr.x (mgr.34640) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:45:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:45:59 smithi145 bash[35820]: cluster 2024-02-10T08:45:58.299858+0000 mgr.x (mgr.34640) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:00.675 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:00 smithi040 systemd[1]: Stopping Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:46:00.675 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:00 smithi040 bash[50547]: ts=2024-02-10T08:46:00.432Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:46:01.175 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 podman[59942]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a 2024-02-10T08:46:01.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: cluster 2024-02-10T08:46:00.300309+0000 mgr.x (mgr.34640) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:01.635 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-10T08:46:01.635 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: Stopped Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:46:01.635 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service: Found left-over process 50594 (conmon) in control group while starting unit. Ignoring. 2024-02-10T08:46:01.635 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:46:01.636 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service: Found left-over process 59961 (podman) in control group while starting unit. Ignoring. 2024-02-10T08:46:01.636 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:46:01.636 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: Starting Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:46:01.636 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 podman[59980]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a" found: no such container 2024-02-10T08:46:01.636 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 systemd[1]: Started Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:46:01.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.298720+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:01.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: cluster 2024-02-10T08:46:00.300309+0000 mgr.x (mgr.34640) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:01.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.298720+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:01.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.299419+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:01.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.302457+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:01.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.303659+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:46:01.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.304380+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:46:01.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.305032+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:46:01.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[35794]: audit 2024-02-10T08:46:01.306067+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T08:46:01.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.299419+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:01.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.302457+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:01.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.303659+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:46:01.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.304380+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:46:01.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.305032+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:46:01.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[38951]: audit 2024-02-10T08:46:01.306067+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T08:46:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: cluster 2024-02-10T08:46:00.300309+0000 mgr.x (mgr.34640) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.298720+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.299419+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.302457+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 97402224, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441541Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 300626739, \"cpu_percentage\": \"2.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441696Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108947046, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441765Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441827Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45487226, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441886Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45571112, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.441945Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49828331, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442005Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14963179, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442063Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35253125, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:47.442181Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.303659+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.304380+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.305032+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:46:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:01 smithi145 bash[35820]: audit 2024-02-10T08:46:01.306067+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T08:46:02.365 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.890Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-10T08:46:02.365 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.890Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-10T08:46:02.365 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.891Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.40 port=9094 2024-02-10T08:46:02.365 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.892Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-10T08:46:02.365 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.914Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:46:02.366 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.914Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:46:02.366 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.917Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-10T08:46:02.366 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:01 smithi040 bash[59999]: ts=2024-02-10T08:46:01.917Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-10T08:46:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:02 smithi040 bash[35794]: cephadm 2024-02-10T08:46:01.303375+0000 mgr.x (mgr.34640) 19 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T08:46:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:02 smithi040 bash[35794]: cephadm 2024-02-10T08:46:01.305637+0000 mgr.x (mgr.34640) 20 : cephadm [INF] Reconfiguring daemon mon.b on smithi145 2024-02-10T08:46:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:02 smithi040 bash[38951]: cephadm 2024-02-10T08:46:01.303375+0000 mgr.x (mgr.34640) 19 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T08:46:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:02 smithi040 bash[38951]: cephadm 2024-02-10T08:46:01.305637+0000 mgr.x (mgr.34640) 20 : cephadm [INF] Reconfiguring daemon mon.b on smithi145 2024-02-10T08:46:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:02 smithi145 bash[35820]: cephadm 2024-02-10T08:46:01.303375+0000 mgr.x (mgr.34640) 19 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T08:46:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:02 smithi145 bash[35820]: cephadm 2024-02-10T08:46:01.305637+0000 mgr.x (mgr.34640) 20 : cephadm [INF] Reconfiguring daemon mon.b on smithi145 2024-02-10T08:46:03.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[35794]: cluster 2024-02-10T08:46:02.300731+0000 mgr.x (mgr.34640) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:03.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[38951]: cluster 2024-02-10T08:46:02.300731+0000 mgr.x (mgr.34640) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:03.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[35794]: audit 2024-02-10T08:46:02.970294+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:46:03.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[38951]: audit 2024-02-10T08:46:02.970294+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:46:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[35794]: audit 2024-02-10T08:46:02.971028+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:46:03.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[35794]: audit 2024-02-10T08:46:02.974874+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:46:03.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[38951]: audit 2024-02-10T08:46:02.971028+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:46:03.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[38951]: audit 2024-02-10T08:46:02.974874+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:46:03.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:03 smithi145 bash[35820]: cluster 2024-02-10T08:46:02.300731+0000 mgr.x (mgr.34640) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:03.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:03 smithi145 bash[35820]: audit 2024-02-10T08:46:02.970294+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:46:03.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:03 smithi145 bash[35820]: audit 2024-02-10T08:46:02.971028+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:46:03.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:03 smithi145 bash[35820]: audit 2024-02-10T08:46:02.974874+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"2da2a296a6e5\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 29989273, \"cpu_percentage\": \"0.18%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735340Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:37:02.161579Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:36:57.690666Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:45:48.735648Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:46:04.175 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:03 smithi040 bash[59999]: ts=2024-02-10T08:46:03.892Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000163633s 2024-02-10T08:46:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:04 smithi040 bash[35794]: cephadm 2024-02-10T08:46:02.976068+0000 mgr.x (mgr.34640) 22 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-10T08:46:04.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:04 smithi040 bash[35794]: cephadm 2024-02-10T08:46:02.983693+0000 mgr.x (mgr.34640) 23 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi145 2024-02-10T08:46:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:04 smithi040 bash[38951]: cephadm 2024-02-10T08:46:02.976068+0000 mgr.x (mgr.34640) 22 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-10T08:46:04.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:04 smithi040 bash[38951]: cephadm 2024-02-10T08:46:02.983693+0000 mgr.x (mgr.34640) 23 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi145 2024-02-10T08:46:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:04 smithi145 bash[35820]: cephadm 2024-02-10T08:46:02.976068+0000 mgr.x (mgr.34640) 22 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-10T08:46:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:04 smithi145 bash[35820]: cephadm 2024-02-10T08:46:02.983693+0000 mgr.x (mgr.34640) 23 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi145 2024-02-10T08:46:05.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:05 smithi040 bash[35794]: cluster 2024-02-10T08:46:04.301303+0000 mgr.x (mgr.34640) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:05.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:05 smithi040 bash[38951]: cluster 2024-02-10T08:46:04.301303+0000 mgr.x (mgr.34640) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:05 smithi145 bash[35820]: cluster 2024-02-10T08:46:04.301303+0000 mgr.x (mgr.34640) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:07 smithi145 bash[35820]: cluster 2024-02-10T08:46:06.301607+0000 mgr.x (mgr.34640) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:07 smithi040 bash[35794]: cluster 2024-02-10T08:46:06.301607+0000 mgr.x (mgr.34640) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:07 smithi040 bash[38951]: cluster 2024-02-10T08:46:06.301607+0000 mgr.x (mgr.34640) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:09 smithi040 bash[35794]: cluster 2024-02-10T08:46:08.302156+0000 mgr.x (mgr.34640) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:09.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:09 smithi040 bash[38951]: cluster 2024-02-10T08:46:08.302156+0000 mgr.x (mgr.34640) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:09 smithi145 bash[35820]: cluster 2024-02-10T08:46:08.302156+0000 mgr.x (mgr.34640) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:11.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:11 smithi040 bash[35794]: cluster 2024-02-10T08:46:10.302484+0000 mgr.x (mgr.34640) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:11 smithi040 bash[38951]: cluster 2024-02-10T08:46:10.302484+0000 mgr.x (mgr.34640) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:11 smithi145 bash[35820]: cluster 2024-02-10T08:46:10.302484+0000 mgr.x (mgr.34640) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:12.175 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:46:11 smithi040 bash[59999]: ts=2024-02-10T08:46:11.894Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002202077s 2024-02-10T08:46:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:13 smithi040 bash[35794]: cluster 2024-02-10T08:46:12.302888+0000 mgr.x (mgr.34640) 28 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:13 smithi040 bash[38951]: cluster 2024-02-10T08:46:12.302888+0000 mgr.x (mgr.34640) 28 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:13 smithi145 bash[35820]: cluster 2024-02-10T08:46:12.302888+0000 mgr.x (mgr.34640) 28 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:14.282 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:13 smithi145 systemd[1]: Stopping Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=main.go:874 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=main.go:898 level=info msg="Stopping scrape discovery manager..." 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=main.go:912 level=info msg="Stopping notify discovery manager..." 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=main.go:949 level=info msg="Stopping scrape manager..." 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=main.go:894 level=info msg="Scrape discovery manager stopped" 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.041Z caller=main.go:908 level=info msg="Notify discovery manager stopped" 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.042Z caller=main.go:941 level=info msg="Scrape manager stopped" 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.042Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.042Z caller=main.go:1171 level=info msg="Notifier manager stopped" 2024-02-10T08:46:14.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 bash[45993]: ts=2024-02-10T08:46:14.043Z caller=main.go:1183 level=info msg="See you next time!" 2024-02-10T08:46:14.716 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 podman[50937]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a 2024-02-10T08:46:15.032 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service: Succeeded. 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: Stopped Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service: Found left-over process 46008 (conmon) in control group while starting unit. Ignoring. 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service: Found left-over process 50957 (podman) in control group while starting unit. Ignoring. 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: Starting Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:46:15.033 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 podman[50975]: Error: no container with ID or name "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a" found: no such container 2024-02-10T08:46:15.034 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:14 smithi145 systemd[1]: Started Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: cluster 2024-02-10T08:46:14.303508+0000 mgr.x (mgr.34640) 29 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.776441+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.777302+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.780954+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.784452+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.785626+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:46:15.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.786100+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.786368+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.790441+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.795596+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.798945+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.799807+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.800401+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.804442+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.807827+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:46:15.495 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[35820]: audit 2024-02-10T08:46:14.809194+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:46:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: cluster 2024-02-10T08:46:14.303508+0000 mgr.x (mgr.34640) 29 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: cluster 2024-02-10T08:46:14.303508+0000 mgr.x (mgr.34640) 29 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:15.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.776441+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.776441+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:15.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.777302+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:15.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.777302+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:15.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.780954+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:15.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.784452+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.785626+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.786100+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.780954+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 108527616, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.734814Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 431593881, \"cpu_percentage\": \"3.55%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:45:48.734991Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735079Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45183139, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735142Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735205Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46242201, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735267Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735404Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35966156, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735464Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35745955, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:45:48.735524Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.784452+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.785626+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.786100+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.786368+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.790441+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-10T08:46:15.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.795596+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.798945+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.799807+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.800401+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.804442+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.807827+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[38951]: audit 2024-02-10T08:46:14.809194+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.786368+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.790441+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi040.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.795596+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.798945+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.799807+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-10T08:46:15.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.800401+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-10T08:46:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.804442+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi145.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-10T08:46:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.807827+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:46:15.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:15 smithi040 bash[35794]: audit 2024-02-10T08:46:14.809194+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.419Z caller=main.go:544 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.419Z caller=main.go:588 level=info msg="Starting Prometheus Server" mode=server version="(version=2.49.1, branch=HEAD, revision=43e14844a33b65e2a396e3944272af8b3a494071)" 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.419Z caller=main.go:593 level=info build_context="(go=go1.21.6, platform=linux/amd64, user=root@6d5f4c649d25, date=20240115-16:58:43, tags=netgo,builtinassets,stringlabels)" 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.419Z caller=main.go:594 level=info host_details="(Linux 4.18.0-536.el8.x86_64 #1 SMP Thu Jan 18 15:15:29 UTC 2024 x86_64 smithi145 (none))" 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.419Z caller=main.go:595 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.419Z caller=main.go:596 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.420Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.421Z caller=main.go:1039 level=info msg="Starting TSDB ..." 2024-02-10T08:46:15.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.422Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.422Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.424Z caller=head.go:606 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.424Z caller=head.go:687 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=5.339µs 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.424Z caller=head.go:695 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.424Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.438Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.438Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.438Z caller=head.go:803 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=25.092µs wal_replay_duration=14.173742ms wbl_replay_duration=134ns total_replay_duration=14.223218ms 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.440Z caller=main.go:1060 level=info fs_type=XFS_SUPER_MAGIC 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.440Z caller=main.go:1063 level=info msg="TSDB started" 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.440Z caller=main.go:1245 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.453Z caller=main.go:1282 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=13.162001ms db_storage=793ns remote_storage=1.144µs web_handler=433ns query_engine=635ns scrape=371.161µs scrape_sd=25.34µs notify=19.989µs notify_sd=5.469µs rules=12.515552ms tracing=5.652µs 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.454Z caller=main.go:1024 level=info msg="Server is ready to receive web requests." 2024-02-10T08:46:15.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:46:15 smithi145 bash[50992]: ts=2024-02-10T08:46:15.454Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-10T08:46:16.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[38951]: audit 2024-02-10T08:46:14.784848+0000 mgr.x (mgr.34640) 30 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:46:16.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[38951]: audit 2024-02-10T08:46:14.785875+0000 mgr.x (mgr.34640) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:46:16.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[38951]: audit 2024-02-10T08:46:14.796008+0000 mgr.x (mgr.34640) 32 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:46:16.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[38951]: audit 2024-02-10T08:46:14.799315+0000 mgr.x (mgr.34640) 33 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:46:16.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[35794]: audit 2024-02-10T08:46:14.784848+0000 mgr.x (mgr.34640) 30 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:46:16.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[35794]: audit 2024-02-10T08:46:14.785875+0000 mgr.x (mgr.34640) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:46:16.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[35794]: audit 2024-02-10T08:46:14.796008+0000 mgr.x (mgr.34640) 32 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:46:16.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:16 smithi040 bash[35794]: audit 2024-02-10T08:46:14.799315+0000 mgr.x (mgr.34640) 33 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:46:16.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:16 smithi145 bash[35820]: audit 2024-02-10T08:46:14.784848+0000 mgr.x (mgr.34640) 30 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:46:16.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:16 smithi145 bash[35820]: audit 2024-02-10T08:46:14.785875+0000 mgr.x (mgr.34640) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi040.front.sepia.ceph.com:9093"}]: dispatch 2024-02-10T08:46:16.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:16 smithi145 bash[35820]: audit 2024-02-10T08:46:14.796008+0000 mgr.x (mgr.34640) 32 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:46:16.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:16 smithi145 bash[35820]: audit 2024-02-10T08:46:14.799315+0000 mgr.x (mgr.34640) 33 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi145.front.sepia.ceph.com:9095"}]: dispatch 2024-02-10T08:46:17.488 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:17 smithi145 bash[35820]: cluster 2024-02-10T08:46:16.303862+0000 mgr.x (mgr.34640) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:17 smithi040 bash[35794]: cluster 2024-02-10T08:46:16.303862+0000 mgr.x (mgr.34640) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:17.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:17 smithi040 bash[38951]: cluster 2024-02-10T08:46:16.303862+0000 mgr.x (mgr.34640) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:19.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[35794]: cluster 2024-02-10T08:46:18.304453+0000 mgr.x (mgr.34640) 35 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[38951]: cluster 2024-02-10T08:46:18.304453+0000 mgr.x (mgr.34640) 35 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:19.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[35794]: audit 2024-02-10T08:46:19.206808+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:19.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[38951]: audit 2024-02-10T08:46:19.206808+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:19.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[35794]: audit 2024-02-10T08:46:19.207559+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:19.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[35794]: audit 2024-02-10T08:46:19.210492+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:19.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[38951]: audit 2024-02-10T08:46:19.207559+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:19.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:19 smithi040 bash[38951]: audit 2024-02-10T08:46:19.210492+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:19 smithi145 bash[35820]: cluster 2024-02-10T08:46:18.304453+0000 mgr.x (mgr.34640) 35 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:19 smithi145 bash[35820]: audit 2024-02-10T08:46:19.206808+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:19 smithi145 bash[35820]: audit 2024-02-10T08:46:19.207559+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:19 smithi145 bash[35820]: audit 2024-02-10T08:46:19.210492+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"e1e38dadb5ff\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 302199603, \"cpu_percentage\": \"2.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205007Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:31:06.373777Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:32:59.956767Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:19.205649Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:21.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: cluster 2024-02-10T08:46:20.304749+0000 mgr.x (mgr.34640) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:21.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: cluster 2024-02-10T08:46:20.304749+0000 mgr.x (mgr.34640) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:21.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.322094+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:21.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.322094+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:21.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.322877+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:21.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.322877+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:21.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.326293+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:21.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.327726+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.328013+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.331184+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.336349+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.336758+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[35794]: audit 2024-02-10T08:46:21.339906+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.326293+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.327726+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.328013+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.331184+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.336349+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.336758+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:21 smithi040 bash[38951]: audit 2024-02-10T08:46:21.339906+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: cluster 2024-02-10T08:46:20.304749+0000 mgr.x (mgr.34640) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.322094+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.322877+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.326293+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 109576192, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320133Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 439143628, \"cpu_percentage\": \"3.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320274Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320372Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45225082, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320441Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.47%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320506Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320568Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 33533460, \"cpu_percentage\": \"137.11%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320647Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13998489, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320706Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.41%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320764Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 35987128, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:21.320823Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:46:21.320926Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.327726+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.328013+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.331184+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:46:21.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.336349+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.336758+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:46:21.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:21 smithi145 bash[35820]: audit 2024-02-10T08:46:21.339906+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:46:23.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:23 smithi040 bash[35794]: cluster 2024-02-10T08:46:22.305254+0000 mgr.x (mgr.34640) 37 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:23.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:23 smithi040 bash[38951]: cluster 2024-02-10T08:46:22.305254+0000 mgr.x (mgr.34640) 37 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:23 smithi145 bash[35820]: cluster 2024-02-10T08:46:22.305254+0000 mgr.x (mgr.34640) 37 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:25 smithi040 bash[35794]: cluster 2024-02-10T08:46:24.306006+0000 mgr.x (mgr.34640) 38 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:25 smithi040 bash[38951]: cluster 2024-02-10T08:46:24.306006+0000 mgr.x (mgr.34640) 38 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:25 smithi145 bash[35820]: cluster 2024-02-10T08:46:24.306006+0000 mgr.x (mgr.34640) 38 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:27 smithi145 bash[35820]: cluster 2024-02-10T08:46:26.306552+0000 mgr.x (mgr.34640) 39 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:27 smithi040 bash[35794]: cluster 2024-02-10T08:46:26.306552+0000 mgr.x (mgr.34640) 39 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:27 smithi040 bash[38951]: cluster 2024-02-10T08:46:26.306552+0000 mgr.x (mgr.34640) 39 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:29 smithi040 bash[35794]: cluster 2024-02-10T08:46:28.307294+0000 mgr.x (mgr.34640) 40 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:29 smithi040 bash[38951]: cluster 2024-02-10T08:46:28.307294+0000 mgr.x (mgr.34640) 40 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:29 smithi145 bash[35820]: cluster 2024-02-10T08:46:28.307294+0000 mgr.x (mgr.34640) 40 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:31 smithi040 bash[35794]: cluster 2024-02-10T08:46:30.307808+0000 mgr.x (mgr.34640) 41 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:31 smithi040 bash[38951]: cluster 2024-02-10T08:46:30.307808+0000 mgr.x (mgr.34640) 41 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:31 smithi145 bash[35820]: cluster 2024-02-10T08:46:30.307808+0000 mgr.x (mgr.34640) 41 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:33 smithi040 bash[35794]: cluster 2024-02-10T08:46:32.308206+0000 mgr.x (mgr.34640) 42 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:33 smithi040 bash[38951]: cluster 2024-02-10T08:46:32.308206+0000 mgr.x (mgr.34640) 42 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:33 smithi145 bash[35820]: cluster 2024-02-10T08:46:32.308206+0000 mgr.x (mgr.34640) 42 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:35.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:35 smithi040 bash[35794]: cluster 2024-02-10T08:46:34.309103+0000 mgr.x (mgr.34640) 43 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:35.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:35 smithi040 bash[38951]: cluster 2024-02-10T08:46:34.309103+0000 mgr.x (mgr.34640) 43 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:35 smithi145 bash[35820]: cluster 2024-02-10T08:46:34.309103+0000 mgr.x (mgr.34640) 43 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:37.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:37 smithi145 bash[35820]: cluster 2024-02-10T08:46:36.309658+0000 mgr.x (mgr.34640) 44 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:37 smithi040 bash[35794]: cluster 2024-02-10T08:46:36.309658+0000 mgr.x (mgr.34640) 44 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:37 smithi040 bash[38951]: cluster 2024-02-10T08:46:36.309658+0000 mgr.x (mgr.34640) 44 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:39 smithi040 bash[35794]: cluster 2024-02-10T08:46:38.310421+0000 mgr.x (mgr.34640) 45 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:39 smithi040 bash[38951]: cluster 2024-02-10T08:46:38.310421+0000 mgr.x (mgr.34640) 45 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:39 smithi145 bash[35820]: cluster 2024-02-10T08:46:38.310421+0000 mgr.x (mgr.34640) 45 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:41 smithi040 bash[35794]: cluster 2024-02-10T08:46:40.310993+0000 mgr.x (mgr.34640) 46 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:41 smithi040 bash[38951]: cluster 2024-02-10T08:46:40.310993+0000 mgr.x (mgr.34640) 46 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:41 smithi145 bash[35820]: cluster 2024-02-10T08:46:40.310993+0000 mgr.x (mgr.34640) 46 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.337610+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:46:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.337886+0000 mon.b (mon.2) 122 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:46:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.338055+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.338171+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:46:42.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.338239+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.338814+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:46:42.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.339075+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[35794]: audit 2024-02-10T08:46:42.339348+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.337610+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.337886+0000 mon.b (mon.2) 122 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.338055+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.338171+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.338239+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.338814+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.339075+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:42 smithi040 bash[38951]: audit 2024-02-10T08:46:42.339348+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.337610+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.337886+0000 mon.b (mon.2) 122 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.338055+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.338171+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.338239+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.338814+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.339075+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:46:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:42 smithi145 bash[35820]: audit 2024-02-10T08:46:42.339348+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:46:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:43 smithi040 bash[35794]: cluster 2024-02-10T08:46:42.311624+0000 mgr.x (mgr.34640) 47 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:43.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:43 smithi040 bash[38951]: cluster 2024-02-10T08:46:42.311624+0000 mgr.x (mgr.34640) 47 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:43 smithi145 bash[35820]: cluster 2024-02-10T08:46:42.311624+0000 mgr.x (mgr.34640) 47 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:45 smithi040 bash[35794]: cluster 2024-02-10T08:46:44.312455+0000 mgr.x (mgr.34640) 48 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:45 smithi040 bash[38951]: cluster 2024-02-10T08:46:44.312455+0000 mgr.x (mgr.34640) 48 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:45 smithi145 bash[35820]: cluster 2024-02-10T08:46:44.312455+0000 mgr.x (mgr.34640) 48 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:47 smithi145 bash[35820]: cluster 2024-02-10T08:46:46.312964+0000 mgr.x (mgr.34640) 49 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:47 smithi040 bash[35794]: cluster 2024-02-10T08:46:46.312964+0000 mgr.x (mgr.34640) 49 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:47 smithi040 bash[38951]: cluster 2024-02-10T08:46:46.312964+0000 mgr.x (mgr.34640) 49 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:49 smithi040 bash[35794]: cluster 2024-02-10T08:46:48.313789+0000 mgr.x (mgr.34640) 50 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:49 smithi040 bash[38951]: cluster 2024-02-10T08:46:48.313789+0000 mgr.x (mgr.34640) 50 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:49 smithi145 bash[35820]: cluster 2024-02-10T08:46:48.313789+0000 mgr.x (mgr.34640) 50 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:51 smithi040 bash[35794]: cluster 2024-02-10T08:46:50.314287+0000 mgr.x (mgr.34640) 51 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:51 smithi040 bash[38951]: cluster 2024-02-10T08:46:50.314287+0000 mgr.x (mgr.34640) 51 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:51 smithi145 bash[35820]: cluster 2024-02-10T08:46:50.314287+0000 mgr.x (mgr.34640) 51 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:53 smithi040 bash[35794]: cluster 2024-02-10T08:46:52.314784+0000 mgr.x (mgr.34640) 52 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:53 smithi040 bash[38951]: cluster 2024-02-10T08:46:52.314784+0000 mgr.x (mgr.34640) 52 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:53 smithi145 bash[35820]: cluster 2024-02-10T08:46:52.314784+0000 mgr.x (mgr.34640) 52 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:55 smithi040 bash[35794]: cluster 2024-02-10T08:46:54.315506+0000 mgr.x (mgr.34640) 53 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:55.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:55 smithi040 bash[38951]: cluster 2024-02-10T08:46:54.315506+0000 mgr.x (mgr.34640) 53 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:55 smithi145 bash[35820]: cluster 2024-02-10T08:46:54.315506+0000 mgr.x (mgr.34640) 53 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:57 smithi145 bash[35820]: cluster 2024-02-10T08:46:56.315853+0000 mgr.x (mgr.34640) 54 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:57 smithi040 bash[35794]: cluster 2024-02-10T08:46:56.315853+0000 mgr.x (mgr.34640) 54 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:57 smithi040 bash[38951]: cluster 2024-02-10T08:46:56.315853+0000 mgr.x (mgr.34640) 54 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:46:59 smithi040 bash[35794]: cluster 2024-02-10T08:46:58.316604+0000 mgr.x (mgr.34640) 55 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:46:59 smithi040 bash[38951]: cluster 2024-02-10T08:46:58.316604+0000 mgr.x (mgr.34640) 55 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:46:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:46:59 smithi145 bash[35820]: cluster 2024-02-10T08:46:58.316604+0000 mgr.x (mgr.34640) 55 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:01 smithi040 bash[35794]: cluster 2024-02-10T08:47:00.317140+0000 mgr.x (mgr.34640) 56 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:01 smithi040 bash[38951]: cluster 2024-02-10T08:47:00.317140+0000 mgr.x (mgr.34640) 56 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:01 smithi145 bash[35820]: cluster 2024-02-10T08:47:00.317140+0000 mgr.x (mgr.34640) 56 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:03.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:03 smithi040 bash[35794]: cluster 2024-02-10T08:47:02.317648+0000 mgr.x (mgr.34640) 57 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:03.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:03 smithi040 bash[38951]: cluster 2024-02-10T08:47:02.317648+0000 mgr.x (mgr.34640) 57 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:03 smithi145 bash[35820]: cluster 2024-02-10T08:47:02.317648+0000 mgr.x (mgr.34640) 57 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:05.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:05 smithi040 bash[35794]: cluster 2024-02-10T08:47:04.318372+0000 mgr.x (mgr.34640) 58 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:05.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:05 smithi040 bash[38951]: cluster 2024-02-10T08:47:04.318372+0000 mgr.x (mgr.34640) 58 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:05 smithi145 bash[35820]: cluster 2024-02-10T08:47:04.318372+0000 mgr.x (mgr.34640) 58 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:07 smithi145 bash[35820]: cluster 2024-02-10T08:47:06.318780+0000 mgr.x (mgr.34640) 59 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:07 smithi040 bash[35794]: cluster 2024-02-10T08:47:06.318780+0000 mgr.x (mgr.34640) 59 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:07 smithi040 bash[38951]: cluster 2024-02-10T08:47:06.318780+0000 mgr.x (mgr.34640) 59 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:09 smithi040 bash[35794]: cluster 2024-02-10T08:47:08.319698+0000 mgr.x (mgr.34640) 60 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:09.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:09 smithi040 bash[38951]: cluster 2024-02-10T08:47:08.319698+0000 mgr.x (mgr.34640) 60 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:09 smithi145 bash[35820]: cluster 2024-02-10T08:47:08.319698+0000 mgr.x (mgr.34640) 60 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:11 smithi040 bash[35794]: cluster 2024-02-10T08:47:10.320111+0000 mgr.x (mgr.34640) 61 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:11.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:11 smithi040 bash[38951]: cluster 2024-02-10T08:47:10.320111+0000 mgr.x (mgr.34640) 61 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:11 smithi145 bash[35820]: cluster 2024-02-10T08:47:10.320111+0000 mgr.x (mgr.34640) 61 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:13 smithi040 bash[35794]: cluster 2024-02-10T08:47:12.320666+0000 mgr.x (mgr.34640) 62 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:13 smithi040 bash[38951]: cluster 2024-02-10T08:47:12.320666+0000 mgr.x (mgr.34640) 62 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:13 smithi145 bash[35820]: cluster 2024-02-10T08:47:12.320666+0000 mgr.x (mgr.34640) 62 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:15 smithi040 bash[35794]: cluster 2024-02-10T08:47:14.321657+0000 mgr.x (mgr.34640) 63 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:15 smithi040 bash[38951]: cluster 2024-02-10T08:47:14.321657+0000 mgr.x (mgr.34640) 63 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:15 smithi145 bash[35820]: cluster 2024-02-10T08:47:14.321657+0000 mgr.x (mgr.34640) 63 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:17 smithi145 bash[35820]: cluster 2024-02-10T08:47:16.322117+0000 mgr.x (mgr.34640) 64 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:17 smithi040 bash[35794]: cluster 2024-02-10T08:47:16.322117+0000 mgr.x (mgr.34640) 64 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:17.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:17 smithi040 bash[38951]: cluster 2024-02-10T08:47:16.322117+0000 mgr.x (mgr.34640) 64 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:19 smithi040 bash[35794]: cluster 2024-02-10T08:47:18.322954+0000 mgr.x (mgr.34640) 65 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:19 smithi040 bash[38951]: cluster 2024-02-10T08:47:18.322954+0000 mgr.x (mgr.34640) 65 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:19 smithi145 bash[35820]: cluster 2024-02-10T08:47:18.322954+0000 mgr.x (mgr.34640) 65 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:21 smithi040 bash[35794]: cluster 2024-02-10T08:47:20.323399+0000 mgr.x (mgr.34640) 66 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:21.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:21 smithi040 bash[38951]: cluster 2024-02-10T08:47:20.323399+0000 mgr.x (mgr.34640) 66 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:21 smithi145 bash[35820]: cluster 2024-02-10T08:47:20.323399+0000 mgr.x (mgr.34640) 66 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:22 smithi040 bash[35794]: audit 2024-02-10T08:47:21.654907+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:47:22.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:22 smithi040 bash[35794]: audit 2024-02-10T08:47:21.655367+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:47:22.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:22 smithi040 bash[35794]: audit 2024-02-10T08:47:21.657962+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:47:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:22 smithi040 bash[38951]: audit 2024-02-10T08:47:21.654907+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:47:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:22 smithi040 bash[38951]: audit 2024-02-10T08:47:21.655367+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:47:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:22 smithi040 bash[38951]: audit 2024-02-10T08:47:21.657962+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:47:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:22 smithi145 bash[35820]: audit 2024-02-10T08:47:21.654907+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:47:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:22 smithi145 bash[35820]: audit 2024-02-10T08:47:21.655367+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:47:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:22 smithi145 bash[35820]: audit 2024-02-10T08:47:21.657962+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:47:23.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:23 smithi040 bash[35794]: cluster 2024-02-10T08:47:22.323813+0000 mgr.x (mgr.34640) 67 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:23.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:23 smithi040 bash[38951]: cluster 2024-02-10T08:47:22.323813+0000 mgr.x (mgr.34640) 67 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:23 smithi145 bash[35820]: cluster 2024-02-10T08:47:22.323813+0000 mgr.x (mgr.34640) 67 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:25 smithi040 bash[35794]: cluster 2024-02-10T08:47:24.324656+0000 mgr.x (mgr.34640) 68 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:25 smithi040 bash[38951]: cluster 2024-02-10T08:47:24.324656+0000 mgr.x (mgr.34640) 68 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:25 smithi145 bash[35820]: cluster 2024-02-10T08:47:24.324656+0000 mgr.x (mgr.34640) 68 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:27.261 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:47:26 smithi040 bash[59999]: ts=2024-02-10T08:47:26.951Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:47:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:27 smithi145 bash[35820]: cluster 2024-02-10T08:47:26.325204+0000 mgr.x (mgr.34640) 69 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:27 smithi040 bash[35794]: cluster 2024-02-10T08:47:26.325204+0000 mgr.x (mgr.34640) 69 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:27 smithi040 bash[38951]: cluster 2024-02-10T08:47:26.325204+0000 mgr.x (mgr.34640) 69 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:29 smithi040 bash[35794]: cluster 2024-02-10T08:47:28.325956+0000 mgr.x (mgr.34640) 70 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:29 smithi040 bash[38951]: cluster 2024-02-10T08:47:28.325956+0000 mgr.x (mgr.34640) 70 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:29 smithi145 bash[35820]: cluster 2024-02-10T08:47:28.325956+0000 mgr.x (mgr.34640) 70 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:31 smithi040 bash[35794]: cluster 2024-02-10T08:47:30.326490+0000 mgr.x (mgr.34640) 71 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:31 smithi040 bash[38951]: cluster 2024-02-10T08:47:30.326490+0000 mgr.x (mgr.34640) 71 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:31 smithi145 bash[35820]: cluster 2024-02-10T08:47:30.326490+0000 mgr.x (mgr.34640) 71 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:33.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:33 smithi040 bash[35794]: cluster 2024-02-10T08:47:32.326956+0000 mgr.x (mgr.34640) 72 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:33 smithi040 bash[38951]: cluster 2024-02-10T08:47:32.326956+0000 mgr.x (mgr.34640) 72 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:33 smithi145 bash[35820]: cluster 2024-02-10T08:47:32.326956+0000 mgr.x (mgr.34640) 72 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:35.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:35 smithi040 bash[35794]: cluster 2024-02-10T08:47:34.327855+0000 mgr.x (mgr.34640) 73 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:35.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:35 smithi040 bash[38951]: cluster 2024-02-10T08:47:34.327855+0000 mgr.x (mgr.34640) 73 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:35 smithi145 bash[35820]: cluster 2024-02-10T08:47:34.327855+0000 mgr.x (mgr.34640) 73 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:37 smithi145 bash[35820]: cluster 2024-02-10T08:47:36.328398+0000 mgr.x (mgr.34640) 74 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:37 smithi040 bash[35794]: cluster 2024-02-10T08:47:36.328398+0000 mgr.x (mgr.34640) 74 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:37.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:37 smithi040 bash[38951]: cluster 2024-02-10T08:47:36.328398+0000 mgr.x (mgr.34640) 74 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:39 smithi040 bash[35794]: cluster 2024-02-10T08:47:38.329244+0000 mgr.x (mgr.34640) 75 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:39 smithi040 bash[38951]: cluster 2024-02-10T08:47:38.329244+0000 mgr.x (mgr.34640) 75 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:39 smithi145 bash[35820]: cluster 2024-02-10T08:47:38.329244+0000 mgr.x (mgr.34640) 75 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:41 smithi040 bash[35794]: cluster 2024-02-10T08:47:40.329718+0000 mgr.x (mgr.34640) 76 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:41 smithi040 bash[38951]: cluster 2024-02-10T08:47:40.329718+0000 mgr.x (mgr.34640) 76 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:41 smithi145 bash[35820]: cluster 2024-02-10T08:47:40.329718+0000 mgr.x (mgr.34640) 76 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.341666+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T08:47:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.341908+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.342093+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.342255+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.342271+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.342794+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.343054+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[35794]: audit 2024-02-10T08:47:42.343288+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.341666+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.341908+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.342093+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.342255+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.342271+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.342794+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.343054+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:42 smithi040 bash[38951]: audit 2024-02-10T08:47:42.343288+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:47:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.341666+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T08:47:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.341908+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.342093+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.342255+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T08:47:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.342271+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:47:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.342794+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.343054+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:47:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:42 smithi145 bash[35820]: audit 2024-02-10T08:47:42.343288+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:47:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:43 smithi040 bash[35794]: cluster 2024-02-10T08:47:42.330276+0000 mgr.x (mgr.34640) 77 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:43.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:43 smithi040 bash[38951]: cluster 2024-02-10T08:47:42.330276+0000 mgr.x (mgr.34640) 77 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:43 smithi145 bash[35820]: cluster 2024-02-10T08:47:42.330276+0000 mgr.x (mgr.34640) 77 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:45 smithi040 bash[35794]: cluster 2024-02-10T08:47:44.331158+0000 mgr.x (mgr.34640) 78 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:45 smithi040 bash[38951]: cluster 2024-02-10T08:47:44.331158+0000 mgr.x (mgr.34640) 78 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:45 smithi145 bash[35820]: cluster 2024-02-10T08:47:44.331158+0000 mgr.x (mgr.34640) 78 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:47 smithi145 bash[35820]: cluster 2024-02-10T08:47:46.331565+0000 mgr.x (mgr.34640) 79 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:47 smithi040 bash[35794]: cluster 2024-02-10T08:47:46.331565+0000 mgr.x (mgr.34640) 79 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:47 smithi040 bash[38951]: cluster 2024-02-10T08:47:46.331565+0000 mgr.x (mgr.34640) 79 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:49 smithi040 bash[35794]: cluster 2024-02-10T08:47:48.332220+0000 mgr.x (mgr.34640) 80 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:49.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:49 smithi040 bash[38951]: cluster 2024-02-10T08:47:48.332220+0000 mgr.x (mgr.34640) 80 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:49 smithi145 bash[35820]: cluster 2024-02-10T08:47:48.332220+0000 mgr.x (mgr.34640) 80 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:51 smithi040 bash[35794]: cluster 2024-02-10T08:47:50.332676+0000 mgr.x (mgr.34640) 81 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:51 smithi040 bash[38951]: cluster 2024-02-10T08:47:50.332676+0000 mgr.x (mgr.34640) 81 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:51 smithi145 bash[35820]: cluster 2024-02-10T08:47:50.332676+0000 mgr.x (mgr.34640) 81 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:53 smithi040 bash[35794]: cluster 2024-02-10T08:47:52.333234+0000 mgr.x (mgr.34640) 82 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:53.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:47:53 smithi040 bash[59999]: ts=2024-02-10T08:47:53.248Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephMgrPrometheusModuleInactive\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:47:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:53 smithi040 bash[38951]: cluster 2024-02-10T08:47:52.333234+0000 mgr.x (mgr.34640) 82 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:53 smithi145 bash[35820]: cluster 2024-02-10T08:47:52.333234+0000 mgr.x (mgr.34640) 82 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:55 smithi040 bash[35794]: cluster 2024-02-10T08:47:54.334072+0000 mgr.x (mgr.34640) 83 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:55.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:55 smithi040 bash[38951]: cluster 2024-02-10T08:47:54.334072+0000 mgr.x (mgr.34640) 83 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:55 smithi145 bash[35820]: cluster 2024-02-10T08:47:54.334072+0000 mgr.x (mgr.34640) 83 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:57 smithi145 bash[35820]: cluster 2024-02-10T08:47:56.334443+0000 mgr.x (mgr.34640) 84 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:57 smithi040 bash[35794]: cluster 2024-02-10T08:47:56.334443+0000 mgr.x (mgr.34640) 84 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:57.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:57 smithi040 bash[38951]: cluster 2024-02-10T08:47:56.334443+0000 mgr.x (mgr.34640) 84 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:47:59 smithi040 bash[35794]: cluster 2024-02-10T08:47:58.335107+0000 mgr.x (mgr.34640) 85 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:59.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:47:59 smithi040 bash[38951]: cluster 2024-02-10T08:47:58.335107+0000 mgr.x (mgr.34640) 85 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:47:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:47:59 smithi145 bash[35820]: cluster 2024-02-10T08:47:58.335107+0000 mgr.x (mgr.34640) 85 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:01 smithi040 bash[35794]: cluster 2024-02-10T08:48:00.335460+0000 mgr.x (mgr.34640) 86 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:01.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:01 smithi040 bash[38951]: cluster 2024-02-10T08:48:00.335460+0000 mgr.x (mgr.34640) 86 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:01 smithi145 bash[35820]: cluster 2024-02-10T08:48:00.335460+0000 mgr.x (mgr.34640) 86 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:03.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:03 smithi040 bash[35794]: cluster 2024-02-10T08:48:02.336020+0000 mgr.x (mgr.34640) 87 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:03.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:03 smithi040 bash[38951]: cluster 2024-02-10T08:48:02.336020+0000 mgr.x (mgr.34640) 87 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:03 smithi145 bash[35820]: cluster 2024-02-10T08:48:02.336020+0000 mgr.x (mgr.34640) 87 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:05.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:05 smithi040 bash[35794]: cluster 2024-02-10T08:48:04.336696+0000 mgr.x (mgr.34640) 88 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:05.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:05 smithi040 bash[38951]: cluster 2024-02-10T08:48:04.336696+0000 mgr.x (mgr.34640) 88 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:05 smithi145 bash[35820]: cluster 2024-02-10T08:48:04.336696+0000 mgr.x (mgr.34640) 88 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:07 smithi145 bash[35820]: cluster 2024-02-10T08:48:06.337171+0000 mgr.x (mgr.34640) 89 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:07 smithi040 bash[35794]: cluster 2024-02-10T08:48:06.337171+0000 mgr.x (mgr.34640) 89 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:07 smithi040 bash[38951]: cluster 2024-02-10T08:48:06.337171+0000 mgr.x (mgr.34640) 89 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:09 smithi040 bash[35794]: cluster 2024-02-10T08:48:08.337969+0000 mgr.x (mgr.34640) 90 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:09 smithi040 bash[38951]: cluster 2024-02-10T08:48:08.337969+0000 mgr.x (mgr.34640) 90 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:09 smithi145 bash[35820]: cluster 2024-02-10T08:48:08.337969+0000 mgr.x (mgr.34640) 90 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:11.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:11 smithi040 bash[38951]: cluster 2024-02-10T08:48:10.338458+0000 mgr.x (mgr.34640) 91 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:11 smithi040 bash[35794]: cluster 2024-02-10T08:48:10.338458+0000 mgr.x (mgr.34640) 91 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:11 smithi145 bash[35820]: cluster 2024-02-10T08:48:10.338458+0000 mgr.x (mgr.34640) 91 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:13 smithi040 bash[35794]: cluster 2024-02-10T08:48:12.338894+0000 mgr.x (mgr.34640) 92 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:13 smithi040 bash[38951]: cluster 2024-02-10T08:48:12.338894+0000 mgr.x (mgr.34640) 92 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:13 smithi145 bash[35820]: cluster 2024-02-10T08:48:12.338894+0000 mgr.x (mgr.34640) 92 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:15 smithi040 bash[35794]: cluster 2024-02-10T08:48:14.339736+0000 mgr.x (mgr.34640) 93 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:15 smithi040 bash[38951]: cluster 2024-02-10T08:48:14.339736+0000 mgr.x (mgr.34640) 93 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:15 smithi145 bash[35820]: cluster 2024-02-10T08:48:14.339736+0000 mgr.x (mgr.34640) 93 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:48:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:17 smithi145 bash[35820]: cluster 2024-02-10T08:48:16.340165+0000 mgr.x (mgr.34640) 94 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:17 smithi040 bash[35794]: cluster 2024-02-10T08:48:16.340165+0000 mgr.x (mgr.34640) 94 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:17 smithi040 bash[38951]: cluster 2024-02-10T08:48:16.340165+0000 mgr.x (mgr.34640) 94 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:19 smithi040 bash[35794]: cluster 2024-02-10T08:48:18.340903+0000 mgr.x (mgr.34640) 95 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:19 smithi040 bash[38951]: cluster 2024-02-10T08:48:18.340903+0000 mgr.x (mgr.34640) 95 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:19 smithi145 bash[35820]: cluster 2024-02-10T08:48:18.340903+0000 mgr.x (mgr.34640) 95 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:21 smithi040 bash[35794]: cluster 2024-02-10T08:48:20.341469+0000 mgr.x (mgr.34640) 96 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:21.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:21 smithi040 bash[38951]: cluster 2024-02-10T08:48:20.341469+0000 mgr.x (mgr.34640) 96 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:21 smithi145 bash[35820]: cluster 2024-02-10T08:48:20.341469+0000 mgr.x (mgr.34640) 96 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:22 smithi040 bash[35794]: audit 2024-02-10T08:48:21.967152+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:22.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:22 smithi040 bash[35794]: audit 2024-02-10T08:48:21.967644+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:22.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:22 smithi040 bash[35794]: audit 2024-02-10T08:48:21.970385+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:48:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:22 smithi040 bash[38951]: audit 2024-02-10T08:48:21.967152+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:22 smithi040 bash[38951]: audit 2024-02-10T08:48:21.967644+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:22 smithi040 bash[38951]: audit 2024-02-10T08:48:21.970385+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:48:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:22 smithi145 bash[35820]: audit 2024-02-10T08:48:21.967152+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:22 smithi145 bash[35820]: audit 2024-02-10T08:48:21.967644+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:22 smithi145 bash[35820]: audit 2024-02-10T08:48:21.970385+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:48:23.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:23 smithi040 bash[35794]: cluster 2024-02-10T08:48:22.341810+0000 mgr.x (mgr.34640) 97 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:23.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:23 smithi040 bash[38951]: cluster 2024-02-10T08:48:22.341810+0000 mgr.x (mgr.34640) 97 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:23 smithi145 bash[35820]: cluster 2024-02-10T08:48:22.341810+0000 mgr.x (mgr.34640) 97 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:25 smithi040 bash[35794]: cluster 2024-02-10T08:48:24.342527+0000 mgr.x (mgr.34640) 98 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:25 smithi040 bash[38951]: cluster 2024-02-10T08:48:24.342527+0000 mgr.x (mgr.34640) 98 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:25 smithi145 bash[35820]: cluster 2024-02-10T08:48:24.342527+0000 mgr.x (mgr.34640) 98 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:27.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:27 smithi145 bash[35820]: cluster 2024-02-10T08:48:26.342930+0000 mgr.x (mgr.34640) 99 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:27 smithi040 bash[35794]: cluster 2024-02-10T08:48:26.342930+0000 mgr.x (mgr.34640) 99 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:27 smithi040 bash[38951]: cluster 2024-02-10T08:48:26.342930+0000 mgr.x (mgr.34640) 99 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:29 smithi040 bash[35794]: cluster 2024-02-10T08:48:28.343732+0000 mgr.x (mgr.34640) 100 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:29 smithi040 bash[38951]: cluster 2024-02-10T08:48:28.343732+0000 mgr.x (mgr.34640) 100 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:29 smithi145 bash[35820]: cluster 2024-02-10T08:48:28.343732+0000 mgr.x (mgr.34640) 100 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:31 smithi040 bash[35794]: cluster 2024-02-10T08:48:30.344275+0000 mgr.x (mgr.34640) 101 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:31 smithi040 bash[38951]: cluster 2024-02-10T08:48:30.344275+0000 mgr.x (mgr.34640) 101 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:31 smithi145 bash[35820]: cluster 2024-02-10T08:48:30.344275+0000 mgr.x (mgr.34640) 101 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:33.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:33 smithi040 bash[35794]: cluster 2024-02-10T08:48:32.344779+0000 mgr.x (mgr.34640) 102 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:33 smithi040 bash[38951]: cluster 2024-02-10T08:48:32.344779+0000 mgr.x (mgr.34640) 102 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:33 smithi145 bash[35820]: cluster 2024-02-10T08:48:32.344779+0000 mgr.x (mgr.34640) 102 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:35.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:35 smithi040 bash[35794]: cluster 2024-02-10T08:48:34.345526+0000 mgr.x (mgr.34640) 103 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:35 smithi040 bash[38951]: cluster 2024-02-10T08:48:34.345526+0000 mgr.x (mgr.34640) 103 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:35 smithi145 bash[35820]: cluster 2024-02-10T08:48:34.345526+0000 mgr.x (mgr.34640) 103 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:37 smithi145 bash[35820]: cluster 2024-02-10T08:48:36.345893+0000 mgr.x (mgr.34640) 104 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:37 smithi040 bash[35794]: cluster 2024-02-10T08:48:36.345893+0000 mgr.x (mgr.34640) 104 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:37 smithi040 bash[38951]: cluster 2024-02-10T08:48:36.345893+0000 mgr.x (mgr.34640) 104 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:39 smithi040 bash[35794]: cluster 2024-02-10T08:48:38.346784+0000 mgr.x (mgr.34640) 105 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:39 smithi040 bash[38951]: cluster 2024-02-10T08:48:38.346784+0000 mgr.x (mgr.34640) 105 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:39 smithi145 bash[35820]: cluster 2024-02-10T08:48:38.346784+0000 mgr.x (mgr.34640) 105 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:40.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-10T08:48:41.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:41 smithi040 bash[35794]: cluster 2024-02-10T08:48:40.347236+0000 mgr.x (mgr.34640) 106 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:41 smithi040 bash[38951]: cluster 2024-02-10T08:48:40.347236+0000 mgr.x (mgr.34640) 106 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:41 smithi145 bash[35820]: cluster 2024-02-10T08:48:40.347236+0000 mgr.x (mgr.34640) 106 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:42.414 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.345614+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.345865+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.346027+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.345614+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.345865+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.346027+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.346188+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.346384+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.346947+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:48:42.415 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.347185+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.416 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[38951]: audit 2024-02-10T08:48:42.347449+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.346188+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.346384+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:48:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.346947+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:48:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.347185+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:42 smithi040 bash[35794]: audit 2024-02-10T08:48:42.347449+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.345614+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.345865+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.346027+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.346188+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.346384+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.346947+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.347185+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:48:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:42 smithi145 bash[35820]: audit 2024-02-10T08:48:42.347449+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-10T08:48:43.112 INFO:teuthology.orchestra.run.smithi040.stdout:Scheduled to redeploy mgr.y on host 'smithi040' 2024-02-10T08:48:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: cluster 2024-02-10T08:48:42.347569+0000 mgr.x (mgr.34640) 107 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:42.775777+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? 172.21.15.40:0/3928603764' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.105315+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.105946+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.109484+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]': finished 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.140628+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.141261+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.146290+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.150014+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.150512+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.151436+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.152255+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[35794]: audit 2024-02-10T08:48:43.153340+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-10T08:48:43.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: cluster 2024-02-10T08:48:42.347569+0000 mgr.x (mgr.34640) 107 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:42.775777+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? 172.21.15.40:0/3928603764' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.105315+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.105946+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.109484+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]': finished 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.140628+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.141261+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.146290+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.150014+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.150512+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.151436+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.152255+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:48:43.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:43 smithi040 bash[38951]: audit 2024-02-10T08:48:43.153340+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-10T08:48:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: cluster 2024-02-10T08:48:42.347569+0000 mgr.x (mgr.34640) 107 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:42.775777+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? 172.21.15.40:0/3928603764' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.105315+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.105946+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.109484+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr.y"}]': finished 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.140628+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.141261+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.146290+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.150014+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.150512+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.151436+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.152255+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:48:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:43 smithi145 bash[35820]: audit 2024-02-10T08:48:43.153340+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-10T08:48:43.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps --refresh' 2024-02-10T08:48:44.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:44 smithi040 bash[35794]: audit 2024-02-10T08:48:43.104345+0000 mgr.x (mgr.34640) 108 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:48:44.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:44 smithi040 bash[35794]: cephadm 2024-02-10T08:48:43.111419+0000 mgr.x (mgr.34640) 109 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-02-10T08:48:44.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:44 smithi040 bash[35794]: cephadm 2024-02-10T08:48:43.152879+0000 mgr.x (mgr.34640) 110 : cephadm [INF] Deploying daemon mgr.y on smithi040 2024-02-10T08:48:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:44 smithi040 bash[38951]: audit 2024-02-10T08:48:43.104345+0000 mgr.x (mgr.34640) 108 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:48:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:44 smithi040 bash[38951]: cephadm 2024-02-10T08:48:43.111419+0000 mgr.x (mgr.34640) 109 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-02-10T08:48:44.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:44 smithi040 bash[38951]: cephadm 2024-02-10T08:48:43.152879+0000 mgr.x (mgr.34640) 110 : cephadm [INF] Deploying daemon mgr.y on smithi040 2024-02-10T08:48:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:44 smithi145 bash[35820]: audit 2024-02-10T08:48:43.104345+0000 mgr.x (mgr.34640) 108 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:48:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:44 smithi145 bash[35820]: cephadm 2024-02-10T08:48:43.111419+0000 mgr.x (mgr.34640) 109 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-02-10T08:48:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:44 smithi145 bash[35820]: cephadm 2024-02-10T08:48:43.152879+0000 mgr.x (mgr.34640) 110 : cephadm [INF] Deploying daemon mgr.y on smithi040 2024-02-10T08:48:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:45 smithi040 bash[35794]: cluster 2024-02-10T08:48:44.348390+0000 mgr.x (mgr.34640) 111 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:45.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:45 smithi040 bash[38951]: cluster 2024-02-10T08:48:44.348390+0000 mgr.x (mgr.34640) 111 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:45 smithi145 bash[35820]: cluster 2024-02-10T08:48:44.348390+0000 mgr.x (mgr.34640) 111 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:46.639 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:48:46.639 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (2m) 2m ago 12m 17.0M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:48:46.639 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (12m) 2m ago 12m 34.3M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:48:46.639 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (6m) 2m ago 15m 418M - 16.2.14-521-g0e714d9a 1fbc92c859dc b9b23ff414a1 2024-02-10T08:48:46.639 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 running (17m) 2m ago 17m 288M - 15.2.0 204a01f9b0b6 e1e38dadb5ff 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (17m) 2m ago 17m 105M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (16m) 2m ago 16m 104M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (16m) 2m ago 16m 104M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (12m) 2m ago 12m 13.8M - 1.7.0 72c9c2088986 499f0f53e04a 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (12m) 2m ago 12m 13.3M - 1.7.0 72c9c2088986 b3a2408fef6b 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (15m) 2m ago 15m 46.8M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (15m) 2m ago 15m 43.3M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (14m) 2m ago 14m 43.5M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (14m) 2m ago 14m 47.6M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (14m) 2m ago 14m 45.3M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (13m) 2m ago 13m 43.1M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (13m) 2m ago 13m 42.3M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:48:46.640 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (13m) 2m ago 13m 44.1M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:48:46.641 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (2m) 2m ago 12m 31.9M - 2.49.1 2a72b385beaf 37cd9848751b 2024-02-10T08:48:46.641 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (10m) 2m ago 10m 33.8M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:48:46.641 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (10m) 2m ago 10m 34.3M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:48:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: cluster 2024-02-10T08:48:46.349001+0000 mgr.x (mgr.34640) 112 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.627995+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.628451+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.628843+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.629217+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.629598+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.629965+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.632008+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.632400+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.632793+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.633162+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[35794]: audit 2024-02-10T08:48:46.633538+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: cluster 2024-02-10T08:48:46.349001+0000 mgr.x (mgr.34640) 112 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.627995+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.628451+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.628843+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.629217+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.629598+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.629965+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.632008+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.632400+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.632793+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.633162+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:47 smithi040 bash[38951]: audit 2024-02-10T08:48:46.633538+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: cluster 2024-02-10T08:48:46.349001+0000 mgr.x (mgr.34640) 112 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.627995+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.628451+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.628843+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.629217+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.629598+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.629965+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.632008+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:48:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.632400+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.632793+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.633162+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:47 smithi145 bash[35820]: audit 2024-02-10T08:48:46.633538+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:48:47.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 180' 2024-02-10T08:48:48.280 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:48 smithi040 bash[38951]: audit 2024-02-10T08:48:46.625478+0000 mgr.x (mgr.34640) 113 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:48:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:48 smithi145 bash[35820]: audit 2024-02-10T08:48:46.625478+0000 mgr.x (mgr.34640) 113 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:48:48.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:48 smithi040 bash[35794]: audit 2024-02-10T08:48:46.625478+0000 mgr.x (mgr.34640) 113 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:48:49.521 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:49 smithi040 bash[38951]: cluster 2024-02-10T08:48:48.349790+0000 mgr.x (mgr.34640) 114 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:49.521 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:49 smithi040 bash[35794]: cluster 2024-02-10T08:48:48.349790+0000 mgr.x (mgr.34640) 114 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:49 smithi145 bash[35820]: cluster 2024-02-10T08:48:48.349790+0000 mgr.x (mgr.34640) 114 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:51 smithi040 bash[35794]: cluster 2024-02-10T08:48:50.350460+0000 mgr.x (mgr.34640) 115 : cluster [DBG] pgmap v97: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:51.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:51 smithi040 bash[38951]: cluster 2024-02-10T08:48:50.350460+0000 mgr.x (mgr.34640) 115 : cluster [DBG] pgmap v97: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:51 smithi145 bash[35820]: cluster 2024-02-10T08:48:50.350460+0000 mgr.x (mgr.34640) 115 : cluster [DBG] pgmap v97: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:53 smithi040 bash[35794]: cluster 2024-02-10T08:48:52.351091+0000 mgr.x (mgr.34640) 116 : cluster [DBG] pgmap v98: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:53.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:53 smithi040 bash[38951]: cluster 2024-02-10T08:48:52.351091+0000 mgr.x (mgr.34640) 116 : cluster [DBG] pgmap v98: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:53 smithi145 bash[35820]: cluster 2024-02-10T08:48:52.351091+0000 mgr.x (mgr.34640) 116 : cluster [DBG] pgmap v98: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:55 smithi040 bash[35794]: cluster 2024-02-10T08:48:54.351819+0000 mgr.x (mgr.34640) 117 : cluster [DBG] pgmap v99: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:55 smithi040 bash[38951]: cluster 2024-02-10T08:48:54.351819+0000 mgr.x (mgr.34640) 117 : cluster [DBG] pgmap v99: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:55 smithi145 bash[35820]: cluster 2024-02-10T08:48:54.351819+0000 mgr.x (mgr.34640) 117 : cluster [DBG] pgmap v99: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:57 smithi040 bash[35794]: cluster 2024-02-10T08:48:56.352175+0000 mgr.x (mgr.34640) 118 : cluster [DBG] pgmap v100: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:57 smithi040 bash[38951]: cluster 2024-02-10T08:48:56.352175+0000 mgr.x (mgr.34640) 118 : cluster [DBG] pgmap v100: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:57 smithi145 bash[35820]: cluster 2024-02-10T08:48:56.352175+0000 mgr.x (mgr.34640) 118 : cluster [DBG] pgmap v100: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:48:59 smithi040 bash[35794]: cluster 2024-02-10T08:48:58.352939+0000 mgr.x (mgr.34640) 119 : cluster [DBG] pgmap v101: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:59.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:48:59 smithi040 bash[38951]: cluster 2024-02-10T08:48:58.352939+0000 mgr.x (mgr.34640) 119 : cluster [DBG] pgmap v101: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:48:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:48:59 smithi145 bash[35820]: cluster 2024-02-10T08:48:58.352939+0000 mgr.x (mgr.34640) 119 : cluster [DBG] pgmap v101: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:01 smithi145 bash[35820]: cluster 2024-02-10T08:49:00.353363+0000 mgr.x (mgr.34640) 120 : cluster [DBG] pgmap v102: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:01 smithi040 bash[35794]: cluster 2024-02-10T08:49:00.353363+0000 mgr.x (mgr.34640) 120 : cluster [DBG] pgmap v102: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:01.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:01 smithi040 bash[38951]: cluster 2024-02-10T08:49:00.353363+0000 mgr.x (mgr.34640) 120 : cluster [DBG] pgmap v102: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:02 smithi145 bash[35820]: cluster 2024-02-10T08:49:02.353906+0000 mgr.x (mgr.34640) 121 : cluster [DBG] pgmap v103: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:02.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:02 smithi040 bash[35794]: cluster 2024-02-10T08:49:02.353906+0000 mgr.x (mgr.34640) 121 : cluster [DBG] pgmap v103: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:02.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:02 smithi040 bash[38951]: cluster 2024-02-10T08:49:02.353906+0000 mgr.x (mgr.34640) 121 : cluster [DBG] pgmap v103: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:05.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:05 smithi040 bash[35794]: cluster 2024-02-10T08:49:04.354783+0000 mgr.x (mgr.34640) 122 : cluster [DBG] pgmap v104: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:05.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:05 smithi040 bash[38951]: cluster 2024-02-10T08:49:04.354783+0000 mgr.x (mgr.34640) 122 : cluster [DBG] pgmap v104: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:05 smithi145 bash[35820]: cluster 2024-02-10T08:49:04.354783+0000 mgr.x (mgr.34640) 122 : cluster [DBG] pgmap v104: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:07 smithi040 bash[35794]: cluster 2024-02-10T08:49:06.355210+0000 mgr.x (mgr.34640) 123 : cluster [DBG] pgmap v105: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:07 smithi040 bash[38951]: cluster 2024-02-10T08:49:06.355210+0000 mgr.x (mgr.34640) 123 : cluster [DBG] pgmap v105: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:07 smithi145 bash[35820]: cluster 2024-02-10T08:49:06.355210+0000 mgr.x (mgr.34640) 123 : cluster [DBG] pgmap v105: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:09 smithi040 bash[35794]: cluster 2024-02-10T08:49:08.355897+0000 mgr.x (mgr.34640) 124 : cluster [DBG] pgmap v106: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:09.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:09 smithi040 bash[38951]: cluster 2024-02-10T08:49:08.355897+0000 mgr.x (mgr.34640) 124 : cluster [DBG] pgmap v106: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:09 smithi145 bash[35820]: cluster 2024-02-10T08:49:08.355897+0000 mgr.x (mgr.34640) 124 : cluster [DBG] pgmap v106: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:11 smithi040 bash[35794]: cluster 2024-02-10T08:49:10.356337+0000 mgr.x (mgr.34640) 125 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:11 smithi040 bash[38951]: cluster 2024-02-10T08:49:10.356337+0000 mgr.x (mgr.34640) 125 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:11 smithi145 bash[35820]: cluster 2024-02-10T08:49:10.356337+0000 mgr.x (mgr.34640) 125 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:13 smithi040 bash[35794]: cluster 2024-02-10T08:49:12.356803+0000 mgr.x (mgr.34640) 126 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:13 smithi040 bash[38951]: cluster 2024-02-10T08:49:12.356803+0000 mgr.x (mgr.34640) 126 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:13 smithi145 bash[35820]: cluster 2024-02-10T08:49:12.356803+0000 mgr.x (mgr.34640) 126 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:15 smithi040 bash[35794]: cluster 2024-02-10T08:49:14.357487+0000 mgr.x (mgr.34640) 127 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:15.676 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:15 smithi040 systemd[1]: Stopping Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:49:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:15 smithi040 bash[38951]: cluster 2024-02-10T08:49:14.357487+0000 mgr.x (mgr.34640) 127 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:15 smithi145 bash[35820]: cluster 2024-02-10T08:49:14.357487+0000 mgr.x (mgr.34640) 127 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:17 smithi040 bash[35794]: cluster 2024-02-10T08:49:16.358096+0000 mgr.x (mgr.34640) 128 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:17 smithi040 bash[38951]: cluster 2024-02-10T08:49:16.358096+0000 mgr.x (mgr.34640) 128 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:17 smithi145 bash[35820]: cluster 2024-02-10T08:49:16.358096+0000 mgr.x (mgr.34640) 128 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:19 smithi040 bash[35794]: cluster 2024-02-10T08:49:18.359048+0000 mgr.x (mgr.34640) 129 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:19 smithi040 bash[38951]: cluster 2024-02-10T08:49:18.359048+0000 mgr.x (mgr.34640) 129 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:19 smithi145 bash[35820]: cluster 2024-02-10T08:49:18.359048+0000 mgr.x (mgr.34640) 129 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:21 smithi040 bash[35794]: cluster 2024-02-10T08:49:20.359575+0000 mgr.x (mgr.34640) 130 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:21.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:21 smithi040 bash[38951]: cluster 2024-02-10T08:49:20.359575+0000 mgr.x (mgr.34640) 130 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:21 smithi145 bash[35820]: cluster 2024-02-10T08:49:20.359575+0000 mgr.x (mgr.34640) 130 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:23.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:23 smithi040 bash[35794]: cluster 2024-02-10T08:49:22.360083+0000 mgr.x (mgr.34640) 131 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:23.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:23 smithi040 bash[38951]: cluster 2024-02-10T08:49:22.360083+0000 mgr.x (mgr.34640) 131 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:23 smithi145 bash[35820]: cluster 2024-02-10T08:49:22.360083+0000 mgr.x (mgr.34640) 131 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:25 smithi040 bash[35794]: cluster 2024-02-10T08:49:24.360827+0000 mgr.x (mgr.34640) 132 : cluster [DBG] pgmap v114: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:25.676 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:25 smithi040 bash[61367]: time="2024-02-10T08:49:25Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.y in 10 seconds, resorting to SIGKILL" 2024-02-10T08:49:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:25 smithi040 bash[38951]: cluster 2024-02-10T08:49:24.360827+0000 mgr.x (mgr.34640) 132 : cluster [DBG] pgmap v114: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:25 smithi145 bash[35820]: cluster 2024-02-10T08:49:24.360827+0000 mgr.x (mgr.34640) 132 : cluster [DBG] pgmap v114: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:26.265 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:26 smithi040 bash[61367]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.y 2024-02-10T08:49:26.670 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:26 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service: Main process exited, code=exited, status=137/n/a 2024-02-10T08:49:26.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:26 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-02-10T08:49:26.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:26 smithi040 systemd[1]: Stopped Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:49:26.926 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:26 smithi040 systemd[1]: Starting Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:49:27.591 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:27 smithi040 bash[35794]: cluster 2024-02-10T08:49:26.361267+0000 mgr.x (mgr.34640) 133 : cluster [DBG] pgmap v115: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:27.592 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:27 smithi040 bash[38951]: cluster 2024-02-10T08:49:26.361267+0000 mgr.x (mgr.34640) 133 : cluster [DBG] pgmap v115: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:27.592 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:27.357+0000 7f61c5429700 1 -- 172.21.15.40:0/2264447152 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e1a718a4e0 con 0x55e1a715ec00 2024-02-10T08:49:27.592 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:27 smithi040 bash[61559]: 396268bc9a9f73b49f6f441bbd8a19adb984f6715e1a84cb212964e0ba274b4c 2024-02-10T08:49:27.592 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:27 smithi040 systemd[1]: Started Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:49:27.592 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:27.488+0000 7f61d5a25680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:49:27.592 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:27.590+0000 7f61d5a25680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:49:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:27 smithi145 bash[35820]: cluster 2024-02-10T08:49:26.361267+0000 mgr.x (mgr.34640) 133 : cluster [DBG] pgmap v115: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:28.289 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:28.017+0000 7f61d5a25680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:49:28.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.537306+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]: dispatch 2024-02-10T08:49:28.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.538051+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]: dispatch 2024-02-10T08:49:28.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.541259+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]': finished 2024-02-10T08:49:28.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.546184+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:28.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.546709+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:28.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.549601+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:28.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.552791+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:49:28.511 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:28 smithi145 bash[35820]: audit 2024-02-10T08:49:27.553024+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:49:28.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.537306+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]: dispatch 2024-02-10T08:49:28.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.537306+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]: dispatch 2024-02-10T08:49:28.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.538051+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]: dispatch 2024-02-10T08:49:28.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.538051+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]: dispatch 2024-02-10T08:49:28.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.541259+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]': finished 2024-02-10T08:49:28.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.541259+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {\"mgr.y\": \"redeploy\"}}"}]': finished 2024-02-10T08:49:28.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.546184+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:28.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.546184+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:28.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.546709+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:28.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.546709+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:28.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.549601+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:28.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.552791+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:49:28.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[38951]: audit 2024-02-10T08:49:27.553024+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:49:28.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.549601+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 110939340, \"cpu_percentage\": \"1.66%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.204844Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 109261619, \"cpu_percentage\": \"0.75%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205090Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49167728, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205157Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45476741, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205220Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45644513, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205282Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49933189, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205357Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14533263, \"cpu_percentage\": \"0.39%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205420Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17836277, \"cpu_percentage\": \"0.73%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:46:19.205481Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35473326, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:46:19.205542Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:28.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.552791+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:49:28.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:28 smithi040 bash[35794]: audit 2024-02-10T08:49:27.553024+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:49:29.165 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:28.845+0000 7f61d5a25680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:49:29.166 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:28.932+0000 7f61d5a25680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:49:29.166 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:29.164+0000 7f61d5a25680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:49:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:29 smithi040 bash[35794]: cluster 2024-02-10T08:49:28.362164+0000 mgr.x (mgr.34640) 134 : cluster [DBG] pgmap v116: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:29 smithi040 bash[38951]: cluster 2024-02-10T08:49:28.362164+0000 mgr.x (mgr.34640) 134 : cluster [DBG] pgmap v116: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:29.461 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:29 smithi145 bash[35820]: cluster 2024-02-10T08:49:28.362164+0000 mgr.x (mgr.34640) 134 : cluster [DBG] pgmap v116: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:30.508 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:30.255+0000 7f61d5a25680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:49:30.508 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:30.423+0000 7f61d5a25680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:49:30.811 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:30.507+0000 7f61d5a25680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:49:30.811 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:30.601+0000 7f61d5a25680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:49:30.812 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:30.810+0000 7f61d5a25680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:49:31.418 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:31.108+0000 7f61d5a25680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:49:31.418 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:31.232+0000 7f61d5a25680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:49:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:31 smithi040 bash[35794]: cluster 2024-02-10T08:49:30.362481+0000 mgr.x (mgr.34640) 135 : cluster [DBG] pgmap v117: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:31 smithi040 bash[38951]: cluster 2024-02-10T08:49:30.362481+0000 mgr.x (mgr.34640) 135 : cluster [DBG] pgmap v117: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:31.679 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:31 smithi145 bash[35820]: cluster 2024-02-10T08:49:30.362481+0000 mgr.x (mgr.34640) 135 : cluster [DBG] pgmap v117: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:32.120 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.015+0000 7f61d5a25680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:49:32.420 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.119+0000 7f61d5a25680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:49:32.421 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.237+0000 7f61d5a25680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:49:32.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.437+0000 7f61d5a25680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:49:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:32 smithi040 bash[38951]: audit 2024-02-10T08:49:32.185588+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:32.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:32 smithi040 bash[35794]: audit 2024-02-10T08:49:32.185588+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:32.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:32 smithi040 bash[38951]: audit 2024-02-10T08:49:32.186211+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:32.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:32 smithi040 bash[38951]: audit 2024-02-10T08:49:32.188969+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:32.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:32 smithi040 bash[35794]: audit 2024-02-10T08:49:32.186211+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:32.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:32 smithi040 bash[35794]: audit 2024-02-10T08:49:32.188969+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:32 smithi145 bash[35820]: audit 2024-02-10T08:49:32.185588+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:32.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:32 smithi145 bash[35820]: audit 2024-02-10T08:49:32.186211+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:32.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:32 smithi145 bash[35820]: audit 2024-02-10T08:49:32.188969+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 106535321, \"cpu_percentage\": \"1.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183569Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 48203038, \"cpu_percentage\": \"107.03%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:49:32.183730Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124361113, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183800Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49136271, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183863Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46368030, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183924Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46766489, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.183985Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50195333, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184046Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184107Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18077450, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184167Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36301701, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:32.184226Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:32.184361Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:32.991 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.709+0000 7f61d5a25680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:49:32.992 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.848+0000 7f61d5a25680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:49:32.992 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:32.990+0000 7f61d5a25680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:49:33.263 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:33.172+0000 7f61d5a25680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:49:33.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:49:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:49:33.262+0000 7f61d5a25680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: cluster 2024-02-10T08:49:32.362783+0000 mgr.x (mgr.34640) 136 : cluster [DBG] pgmap v118: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: cluster 2024-02-10T08:49:33.277741+0000 mon.a (mon.0) 676 : cluster [DBG] Standby manager daemon y restarted 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: cluster 2024-02-10T08:49:33.277826+0000 mon.a (mon.0) 677 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.278475+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.278886+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.279924+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-10T08:49:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.280191+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: cluster 2024-02-10T08:49:32.362783+0000 mgr.x (mgr.34640) 136 : cluster [DBG] pgmap v118: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: cluster 2024-02-10T08:49:33.277741+0000 mon.a (mon.0) 676 : cluster [DBG] Standby manager daemon y restarted 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: cluster 2024-02-10T08:49:33.277826+0000 mon.a (mon.0) 677 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.278475+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.278886+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.279924+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.280191+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:49:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.404252+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:33.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.404252+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.405028+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[38951]: audit 2024-02-10T08:49:33.409403+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.405028+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:33 smithi040 bash[35794]: audit 2024-02-10T08:49:33.409403+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: cluster 2024-02-10T08:49:32.362783+0000 mgr.x (mgr.34640) 136 : cluster [DBG] pgmap v118: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: cluster 2024-02-10T08:49:33.277741+0000 mon.a (mon.0) 676 : cluster [DBG] Standby manager daemon y restarted 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: cluster 2024-02-10T08:49:33.277826+0000 mon.a (mon.0) 677 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.278475+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.278886+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.279924+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.280191+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.404252+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.405028+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:49:33.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:33 smithi145 bash[35820]: audit 2024-02-10T08:49:33.409403+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 128031129, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402258Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 443128217, \"cpu_percentage\": \"2.67%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402430Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48381296, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402503Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46525317, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402567Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402643Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47427092, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402703Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 50656706, \"cpu_percentage\": \"0.37%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402763Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14029946, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402823Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36448501, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402880Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 36825989, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:49:33.402939Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:49:33.403043Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:49:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[35794]: audit 2024-02-10T08:49:33.689316+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:49:34.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[35794]: audit 2024-02-10T08:49:33.689855+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:49:34.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[35794]: audit 2024-02-10T08:49:33.692695+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:49:34.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[35794]: cluster 2024-02-10T08:49:34.195897+0000 mon.a (mon.0) 682 : cluster [DBG] mgrmap e20: x(active, since 3m), standbys: y 2024-02-10T08:49:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[38951]: audit 2024-02-10T08:49:33.689316+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:49:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[38951]: audit 2024-02-10T08:49:33.689855+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:49:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[38951]: audit 2024-02-10T08:49:33.692695+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:49:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:34 smithi040 bash[38951]: cluster 2024-02-10T08:49:34.195897+0000 mon.a (mon.0) 682 : cluster [DBG] mgrmap e20: x(active, since 3m), standbys: y 2024-02-10T08:49:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:34 smithi145 bash[35820]: audit 2024-02-10T08:49:33.689316+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:49:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:34 smithi145 bash[35820]: audit 2024-02-10T08:49:33.689855+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:49:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:34 smithi145 bash[35820]: audit 2024-02-10T08:49:33.692695+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:49:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:34 smithi145 bash[35820]: cluster 2024-02-10T08:49:34.195897+0000 mon.a (mon.0) 682 : cluster [DBG] mgrmap e20: x(active, since 3m), standbys: y 2024-02-10T08:49:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:35 smithi145 bash[35820]: cluster 2024-02-10T08:49:34.363394+0000 mgr.x (mgr.34640) 137 : cluster [DBG] pgmap v119: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:35.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:35 smithi040 bash[35794]: cluster 2024-02-10T08:49:34.363394+0000 mgr.x (mgr.34640) 137 : cluster [DBG] pgmap v119: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:35.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:35 smithi040 bash[38951]: cluster 2024-02-10T08:49:34.363394+0000 mgr.x (mgr.34640) 137 : cluster [DBG] pgmap v119: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:37 smithi040 bash[35794]: cluster 2024-02-10T08:49:36.363739+0000 mgr.x (mgr.34640) 138 : cluster [DBG] pgmap v120: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:37.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:37 smithi040 bash[38951]: cluster 2024-02-10T08:49:36.363739+0000 mgr.x (mgr.34640) 138 : cluster [DBG] pgmap v120: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:37 smithi145 bash[35820]: cluster 2024-02-10T08:49:36.363739+0000 mgr.x (mgr.34640) 138 : cluster [DBG] pgmap v120: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:39 smithi040 bash[35794]: cluster 2024-02-10T08:49:38.364699+0000 mgr.x (mgr.34640) 139 : cluster [DBG] pgmap v121: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:39 smithi040 bash[38951]: cluster 2024-02-10T08:49:38.364699+0000 mgr.x (mgr.34640) 139 : cluster [DBG] pgmap v121: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:39 smithi145 bash[35820]: cluster 2024-02-10T08:49:38.364699+0000 mgr.x (mgr.34640) 139 : cluster [DBG] pgmap v121: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:41 smithi145 bash[35820]: cluster 2024-02-10T08:49:40.365293+0000 mgr.x (mgr.34640) 140 : cluster [DBG] pgmap v122: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:41.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:41 smithi040 bash[35794]: cluster 2024-02-10T08:49:40.365293+0000 mgr.x (mgr.34640) 140 : cluster [DBG] pgmap v122: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:41 smithi040 bash[38951]: cluster 2024-02-10T08:49:40.365293+0000 mgr.x (mgr.34640) 140 : cluster [DBG] pgmap v122: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.351151+0000 mon.b (mon.2) 159 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2024-02-10T08:49:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.351469+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.351650+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:49:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.351696+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2024-02-10T08:49:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.351819+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.352245+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.352467+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:49:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:42 smithi145 bash[35820]: audit 2024-02-10T08:49:42.352712+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.351151+0000 mon.b (mon.2) 159 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.351469+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.351650+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.351696+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.351819+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.352245+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.352467+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[35794]: audit 2024-02-10T08:49:42.352712+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.351151+0000 mon.b (mon.2) 159 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2024-02-10T08:49:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.351469+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.351650+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:49:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.351696+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2024-02-10T08:49:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.351819+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.352245+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:49:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.352467+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:49:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:42 smithi040 bash[38951]: audit 2024-02-10T08:49:42.352712+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:49:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:43 smithi145 bash[35820]: cluster 2024-02-10T08:49:42.365734+0000 mgr.x (mgr.34640) 141 : cluster [DBG] pgmap v123: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:43.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:43 smithi040 bash[35794]: cluster 2024-02-10T08:49:42.365734+0000 mgr.x (mgr.34640) 141 : cluster [DBG] pgmap v123: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:43 smithi040 bash[38951]: cluster 2024-02-10T08:49:42.365734+0000 mgr.x (mgr.34640) 141 : cluster [DBG] pgmap v123: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:45 smithi145 bash[35820]: cluster 2024-02-10T08:49:44.366489+0000 mgr.x (mgr.34640) 142 : cluster [DBG] pgmap v124: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:45.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:45 smithi040 bash[35794]: cluster 2024-02-10T08:49:44.366489+0000 mgr.x (mgr.34640) 142 : cluster [DBG] pgmap v124: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:45.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:45 smithi040 bash[38951]: cluster 2024-02-10T08:49:44.366489+0000 mgr.x (mgr.34640) 142 : cluster [DBG] pgmap v124: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:47 smithi040 bash[35794]: cluster 2024-02-10T08:49:46.366932+0000 mgr.x (mgr.34640) 143 : cluster [DBG] pgmap v125: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:47.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:47 smithi040 bash[38951]: cluster 2024-02-10T08:49:46.366932+0000 mgr.x (mgr.34640) 143 : cluster [DBG] pgmap v125: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:47 smithi145 bash[35820]: cluster 2024-02-10T08:49:46.366932+0000 mgr.x (mgr.34640) 143 : cluster [DBG] pgmap v125: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:49 smithi040 bash[35794]: cluster 2024-02-10T08:49:48.367589+0000 mgr.x (mgr.34640) 144 : cluster [DBG] pgmap v126: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:49 smithi040 bash[38951]: cluster 2024-02-10T08:49:48.367589+0000 mgr.x (mgr.34640) 144 : cluster [DBG] pgmap v126: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:49 smithi145 bash[35820]: cluster 2024-02-10T08:49:48.367589+0000 mgr.x (mgr.34640) 144 : cluster [DBG] pgmap v126: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:51 smithi145 bash[35820]: cluster 2024-02-10T08:49:50.367984+0000 mgr.x (mgr.34640) 145 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:51.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:51 smithi040 bash[35794]: cluster 2024-02-10T08:49:50.367984+0000 mgr.x (mgr.34640) 145 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:51.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:51 smithi040 bash[38951]: cluster 2024-02-10T08:49:50.367984+0000 mgr.x (mgr.34640) 145 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:53 smithi145 bash[35820]: cluster 2024-02-10T08:49:52.368523+0000 mgr.x (mgr.34640) 146 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:53.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:53 smithi040 bash[35794]: cluster 2024-02-10T08:49:52.368523+0000 mgr.x (mgr.34640) 146 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:53 smithi040 bash[38951]: cluster 2024-02-10T08:49:52.368523+0000 mgr.x (mgr.34640) 146 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:55 smithi145 bash[35820]: cluster 2024-02-10T08:49:54.369175+0000 mgr.x (mgr.34640) 147 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:55.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:55 smithi040 bash[35794]: cluster 2024-02-10T08:49:54.369175+0000 mgr.x (mgr.34640) 147 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:55.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:55 smithi040 bash[38951]: cluster 2024-02-10T08:49:54.369175+0000 mgr.x (mgr.34640) 147 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:57 smithi040 bash[35794]: cluster 2024-02-10T08:49:56.369657+0000 mgr.x (mgr.34640) 148 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:57 smithi040 bash[38951]: cluster 2024-02-10T08:49:56.369657+0000 mgr.x (mgr.34640) 148 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:57 smithi145 bash[35820]: cluster 2024-02-10T08:49:56.369657+0000 mgr.x (mgr.34640) 148 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:49:59 smithi145 bash[35820]: cluster 2024-02-10T08:49:58.370373+0000 mgr.x (mgr.34640) 149 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:59.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:49:59 smithi040 bash[35794]: cluster 2024-02-10T08:49:58.370373+0000 mgr.x (mgr.34640) 149 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:49:59.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:49:59 smithi040 bash[38951]: cluster 2024-02-10T08:49:58.370373+0000 mgr.x (mgr.34640) 149 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:01 smithi145 bash[35820]: cluster 2024-02-10T08:50:00.370731+0000 mgr.x (mgr.34640) 150 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:01.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:01 smithi040 bash[35794]: cluster 2024-02-10T08:50:00.370731+0000 mgr.x (mgr.34640) 150 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:01.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:01 smithi040 bash[38951]: cluster 2024-02-10T08:50:00.370731+0000 mgr.x (mgr.34640) 150 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:03 smithi145 bash[35820]: cluster 2024-02-10T08:50:02.371108+0000 mgr.x (mgr.34640) 151 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:03.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:03 smithi040 bash[35794]: cluster 2024-02-10T08:50:02.371108+0000 mgr.x (mgr.34640) 151 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:03.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:03 smithi040 bash[38951]: cluster 2024-02-10T08:50:02.371108+0000 mgr.x (mgr.34640) 151 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:05 smithi145 bash[35820]: cluster 2024-02-10T08:50:04.372007+0000 mgr.x (mgr.34640) 152 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:05.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:05 smithi040 bash[35794]: cluster 2024-02-10T08:50:04.372007+0000 mgr.x (mgr.34640) 152 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:05.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:05 smithi040 bash[38951]: cluster 2024-02-10T08:50:04.372007+0000 mgr.x (mgr.34640) 152 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:07 smithi040 bash[35794]: cluster 2024-02-10T08:50:06.372542+0000 mgr.x (mgr.34640) 153 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:07 smithi040 bash[38951]: cluster 2024-02-10T08:50:06.372542+0000 mgr.x (mgr.34640) 153 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:07 smithi145 bash[35820]: cluster 2024-02-10T08:50:06.372542+0000 mgr.x (mgr.34640) 153 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:09 smithi145 bash[35820]: cluster 2024-02-10T08:50:08.373214+0000 mgr.x (mgr.34640) 154 : cluster [DBG] pgmap v136: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:09.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:09 smithi040 bash[35794]: cluster 2024-02-10T08:50:08.373214+0000 mgr.x (mgr.34640) 154 : cluster [DBG] pgmap v136: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:09 smithi040 bash[38951]: cluster 2024-02-10T08:50:08.373214+0000 mgr.x (mgr.34640) 154 : cluster [DBG] pgmap v136: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:11 smithi145 bash[35820]: cluster 2024-02-10T08:50:10.373699+0000 mgr.x (mgr.34640) 155 : cluster [DBG] pgmap v137: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:11.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:11 smithi040 bash[35794]: cluster 2024-02-10T08:50:10.373699+0000 mgr.x (mgr.34640) 155 : cluster [DBG] pgmap v137: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:11.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:11 smithi040 bash[38951]: cluster 2024-02-10T08:50:10.373699+0000 mgr.x (mgr.34640) 155 : cluster [DBG] pgmap v137: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:13 smithi145 bash[35820]: cluster 2024-02-10T08:50:12.374122+0000 mgr.x (mgr.34640) 156 : cluster [DBG] pgmap v138: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:13.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:13 smithi040 bash[35794]: cluster 2024-02-10T08:50:12.374122+0000 mgr.x (mgr.34640) 156 : cluster [DBG] pgmap v138: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:13.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:13 smithi040 bash[38951]: cluster 2024-02-10T08:50:12.374122+0000 mgr.x (mgr.34640) 156 : cluster [DBG] pgmap v138: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:15 smithi145 bash[35820]: cluster 2024-02-10T08:50:14.374917+0000 mgr.x (mgr.34640) 157 : cluster [DBG] pgmap v139: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:15.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:15 smithi040 bash[35794]: cluster 2024-02-10T08:50:14.374917+0000 mgr.x (mgr.34640) 157 : cluster [DBG] pgmap v139: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:15.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:15 smithi040 bash[38951]: cluster 2024-02-10T08:50:14.374917+0000 mgr.x (mgr.34640) 157 : cluster [DBG] pgmap v139: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:17 smithi040 bash[35794]: cluster 2024-02-10T08:50:16.375401+0000 mgr.x (mgr.34640) 158 : cluster [DBG] pgmap v140: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:17 smithi040 bash[38951]: cluster 2024-02-10T08:50:16.375401+0000 mgr.x (mgr.34640) 158 : cluster [DBG] pgmap v140: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:17 smithi145 bash[35820]: cluster 2024-02-10T08:50:16.375401+0000 mgr.x (mgr.34640) 158 : cluster [DBG] pgmap v140: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:19 smithi145 bash[35820]: cluster 2024-02-10T08:50:18.376189+0000 mgr.x (mgr.34640) 159 : cluster [DBG] pgmap v141: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:19.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:19 smithi040 bash[35794]: cluster 2024-02-10T08:50:18.376189+0000 mgr.x (mgr.34640) 159 : cluster [DBG] pgmap v141: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:19.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:19 smithi040 bash[38951]: cluster 2024-02-10T08:50:18.376189+0000 mgr.x (mgr.34640) 159 : cluster [DBG] pgmap v141: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:21 smithi145 bash[35820]: cluster 2024-02-10T08:50:20.376608+0000 mgr.x (mgr.34640) 160 : cluster [DBG] pgmap v142: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:21.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:21 smithi040 bash[35794]: cluster 2024-02-10T08:50:20.376608+0000 mgr.x (mgr.34640) 160 : cluster [DBG] pgmap v142: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:21.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:21 smithi040 bash[38951]: cluster 2024-02-10T08:50:20.376608+0000 mgr.x (mgr.34640) 160 : cluster [DBG] pgmap v142: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:23 smithi145 bash[35820]: cluster 2024-02-10T08:50:22.376988+0000 mgr.x (mgr.34640) 161 : cluster [DBG] pgmap v143: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:23 smithi040 bash[35794]: cluster 2024-02-10T08:50:22.376988+0000 mgr.x (mgr.34640) 161 : cluster [DBG] pgmap v143: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:23 smithi040 bash[38951]: cluster 2024-02-10T08:50:22.376988+0000 mgr.x (mgr.34640) 161 : cluster [DBG] pgmap v143: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:25 smithi145 bash[35820]: cluster 2024-02-10T08:50:24.377804+0000 mgr.x (mgr.34640) 162 : cluster [DBG] pgmap v144: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:25.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:25 smithi040 bash[35794]: cluster 2024-02-10T08:50:24.377804+0000 mgr.x (mgr.34640) 162 : cluster [DBG] pgmap v144: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:25.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:25 smithi040 bash[38951]: cluster 2024-02-10T08:50:24.377804+0000 mgr.x (mgr.34640) 162 : cluster [DBG] pgmap v144: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:27 smithi040 bash[35794]: cluster 2024-02-10T08:50:26.378211+0000 mgr.x (mgr.34640) 163 : cluster [DBG] pgmap v145: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:27 smithi040 bash[38951]: cluster 2024-02-10T08:50:26.378211+0000 mgr.x (mgr.34640) 163 : cluster [DBG] pgmap v145: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:27 smithi145 bash[35820]: cluster 2024-02-10T08:50:26.378211+0000 mgr.x (mgr.34640) 163 : cluster [DBG] pgmap v145: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:29 smithi145 bash[35820]: cluster 2024-02-10T08:50:28.378927+0000 mgr.x (mgr.34640) 164 : cluster [DBG] pgmap v146: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:29.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:29 smithi040 bash[35794]: cluster 2024-02-10T08:50:28.378927+0000 mgr.x (mgr.34640) 164 : cluster [DBG] pgmap v146: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:29 smithi040 bash[38951]: cluster 2024-02-10T08:50:28.378927+0000 mgr.x (mgr.34640) 164 : cluster [DBG] pgmap v146: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:31 smithi145 bash[35820]: cluster 2024-02-10T08:50:30.379458+0000 mgr.x (mgr.34640) 165 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:31.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:31 smithi040 bash[35794]: cluster 2024-02-10T08:50:30.379458+0000 mgr.x (mgr.34640) 165 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:31.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:31 smithi040 bash[38951]: cluster 2024-02-10T08:50:30.379458+0000 mgr.x (mgr.34640) 165 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:33 smithi145 bash[35820]: cluster 2024-02-10T08:50:32.379977+0000 mgr.x (mgr.34640) 166 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:33.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:33 smithi040 bash[35794]: cluster 2024-02-10T08:50:32.379977+0000 mgr.x (mgr.34640) 166 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:33.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:33 smithi040 bash[38951]: cluster 2024-02-10T08:50:32.379977+0000 mgr.x (mgr.34640) 166 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:34.621 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:34 smithi040 bash[38951]: audit 2024-02-10T08:50:33.698098+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:50:34.622 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:34 smithi040 bash[35794]: audit 2024-02-10T08:50:33.698098+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:50:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:34 smithi145 bash[35820]: audit 2024-02-10T08:50:33.698098+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:50:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:35 smithi145 bash[35820]: cluster 2024-02-10T08:50:34.380754+0000 mgr.x (mgr.34640) 167 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:35.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:35 smithi040 bash[35794]: cluster 2024-02-10T08:50:34.380754+0000 mgr.x (mgr.34640) 167 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:35.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:35 smithi040 bash[38951]: cluster 2024-02-10T08:50:34.380754+0000 mgr.x (mgr.34640) 167 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:37 smithi040 bash[35794]: cluster 2024-02-10T08:50:36.381193+0000 mgr.x (mgr.34640) 168 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:37 smithi040 bash[38951]: cluster 2024-02-10T08:50:36.381193+0000 mgr.x (mgr.34640) 168 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:37 smithi145 bash[35820]: cluster 2024-02-10T08:50:36.381193+0000 mgr.x (mgr.34640) 168 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:38.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:38 smithi040 bash[35794]: audit 2024-02-10T08:50:38.032746+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:50:38.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:38 smithi040 bash[38951]: audit 2024-02-10T08:50:38.032746+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:50:38.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:38 smithi040 bash[35794]: audit 2024-02-10T08:50:38.033656+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:50:38.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:38 smithi040 bash[38951]: audit 2024-02-10T08:50:38.033656+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:50:38.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:38 smithi040 bash[38951]: audit 2024-02-10T08:50:38.036890+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:50:38.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:38 smithi040 bash[35794]: audit 2024-02-10T08:50:38.036890+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:50:38.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:38 smithi145 bash[35820]: audit 2024-02-10T08:50:38.032746+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:50:38.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:38 smithi145 bash[35820]: audit 2024-02-10T08:50:38.033656+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-10T08:50:38.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:38 smithi145 bash[35820]: audit 2024-02-10T08:50:38.036890+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:50:38.031445Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:42:06.111054Z\", \"last_client_files\": {}}"}]': finished 2024-02-10T08:50:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[35794]: audit 2024-02-10T08:50:38.330725+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[35794]: audit 2024-02-10T08:50:38.331261+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[35794]: audit 2024-02-10T08:50:38.334922+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[35794]: cluster 2024-02-10T08:50:38.381950+0000 mgr.x (mgr.34640) 169 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[38951]: audit 2024-02-10T08:50:38.330725+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[38951]: audit 2024-02-10T08:50:38.331261+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[38951]: audit 2024-02-10T08:50:38.334922+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:50:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:39 smithi040 bash[38951]: cluster 2024-02-10T08:50:38.381950+0000 mgr.x (mgr.34640) 169 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:39 smithi145 bash[35820]: audit 2024-02-10T08:50:38.330725+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:50:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:39 smithi145 bash[35820]: audit 2024-02-10T08:50:38.331261+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:50:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:39 smithi145 bash[35820]: audit 2024-02-10T08:50:38.334922+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:50:39.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:39 smithi145 bash[35820]: cluster 2024-02-10T08:50:38.381950+0000 mgr.x (mgr.34640) 169 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:41 smithi145 bash[35820]: cluster 2024-02-10T08:50:40.382397+0000 mgr.x (mgr.34640) 170 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:41.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:41 smithi040 bash[35794]: cluster 2024-02-10T08:50:40.382397+0000 mgr.x (mgr.34640) 170 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:41.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:41 smithi040 bash[38951]: cluster 2024-02-10T08:50:40.382397+0000 mgr.x (mgr.34640) 170 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.355589+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.355873+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.356096+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.356338+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.356391+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.356995+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.357234+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T08:50:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:42 smithi145 bash[35820]: audit 2024-02-10T08:50:42.357454+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.355589+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.355873+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.356096+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.356338+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.356391+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.356995+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.357234+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[35794]: audit 2024-02-10T08:50:42.357454+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.355589+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.355873+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.356096+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T08:50:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.356338+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.356391+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T08:50:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.356995+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:50:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.357234+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T08:50:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:42 smithi040 bash[38951]: audit 2024-02-10T08:50:42.357454+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T08:50:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:43 smithi145 bash[35820]: cluster 2024-02-10T08:50:42.382913+0000 mgr.x (mgr.34640) 171 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:43.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:43 smithi040 bash[35794]: cluster 2024-02-10T08:50:42.382913+0000 mgr.x (mgr.34640) 171 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:43 smithi040 bash[38951]: cluster 2024-02-10T08:50:42.382913+0000 mgr.x (mgr.34640) 171 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:45 smithi145 bash[35820]: cluster 2024-02-10T08:50:44.383662+0000 mgr.x (mgr.34640) 172 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:45.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:45 smithi040 bash[35794]: cluster 2024-02-10T08:50:44.383662+0000 mgr.x (mgr.34640) 172 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:45.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:45 smithi040 bash[38951]: cluster 2024-02-10T08:50:44.383662+0000 mgr.x (mgr.34640) 172 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:47 smithi040 bash[35794]: cluster 2024-02-10T08:50:46.384110+0000 mgr.x (mgr.34640) 173 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:47 smithi040 bash[38951]: cluster 2024-02-10T08:50:46.384110+0000 mgr.x (mgr.34640) 173 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:47 smithi145 bash[35820]: cluster 2024-02-10T08:50:46.384110+0000 mgr.x (mgr.34640) 173 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:49 smithi145 bash[35820]: cluster 2024-02-10T08:50:48.384994+0000 mgr.x (mgr.34640) 174 : cluster [DBG] pgmap v156: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:49.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:49 smithi040 bash[35794]: cluster 2024-02-10T08:50:48.384994+0000 mgr.x (mgr.34640) 174 : cluster [DBG] pgmap v156: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:49.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:49 smithi040 bash[38951]: cluster 2024-02-10T08:50:48.384994+0000 mgr.x (mgr.34640) 174 : cluster [DBG] pgmap v156: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:51 smithi145 bash[35820]: cluster 2024-02-10T08:50:50.385418+0000 mgr.x (mgr.34640) 175 : cluster [DBG] pgmap v157: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:51.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:51 smithi040 bash[35794]: cluster 2024-02-10T08:50:50.385418+0000 mgr.x (mgr.34640) 175 : cluster [DBG] pgmap v157: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:51.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:51 smithi040 bash[38951]: cluster 2024-02-10T08:50:50.385418+0000 mgr.x (mgr.34640) 175 : cluster [DBG] pgmap v157: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:53 smithi145 bash[35820]: cluster 2024-02-10T08:50:52.385965+0000 mgr.x (mgr.34640) 176 : cluster [DBG] pgmap v158: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:53.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:53 smithi040 bash[35794]: cluster 2024-02-10T08:50:52.385965+0000 mgr.x (mgr.34640) 176 : cluster [DBG] pgmap v158: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:53 smithi040 bash[38951]: cluster 2024-02-10T08:50:52.385965+0000 mgr.x (mgr.34640) 176 : cluster [DBG] pgmap v158: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:55 smithi145 bash[35820]: cluster 2024-02-10T08:50:54.386939+0000 mgr.x (mgr.34640) 177 : cluster [DBG] pgmap v159: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:55.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:55 smithi040 bash[35794]: cluster 2024-02-10T08:50:54.386939+0000 mgr.x (mgr.34640) 177 : cluster [DBG] pgmap v159: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:55 smithi040 bash[38951]: cluster 2024-02-10T08:50:54.386939+0000 mgr.x (mgr.34640) 177 : cluster [DBG] pgmap v159: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:57 smithi040 bash[35794]: cluster 2024-02-10T08:50:56.387385+0000 mgr.x (mgr.34640) 178 : cluster [DBG] pgmap v160: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:57 smithi040 bash[38951]: cluster 2024-02-10T08:50:56.387385+0000 mgr.x (mgr.34640) 178 : cluster [DBG] pgmap v160: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:57 smithi145 bash[35820]: cluster 2024-02-10T08:50:56.387385+0000 mgr.x (mgr.34640) 178 : cluster [DBG] pgmap v160: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:50:59 smithi145 bash[35820]: cluster 2024-02-10T08:50:58.388244+0000 mgr.x (mgr.34640) 179 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:59.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:50:59 smithi040 bash[35794]: cluster 2024-02-10T08:50:58.388244+0000 mgr.x (mgr.34640) 179 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:50:59.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:50:59 smithi040 bash[38951]: cluster 2024-02-10T08:50:58.388244+0000 mgr.x (mgr.34640) 179 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:01 smithi145 bash[35820]: cluster 2024-02-10T08:51:00.388709+0000 mgr.x (mgr.34640) 180 : cluster [DBG] pgmap v162: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:01 smithi040 bash[35794]: cluster 2024-02-10T08:51:00.388709+0000 mgr.x (mgr.34640) 180 : cluster [DBG] pgmap v162: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:01.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:01 smithi040 bash[38951]: cluster 2024-02-10T08:51:00.388709+0000 mgr.x (mgr.34640) 180 : cluster [DBG] pgmap v162: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:03 smithi145 bash[35820]: cluster 2024-02-10T08:51:02.389286+0000 mgr.x (mgr.34640) 181 : cluster [DBG] pgmap v163: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:03.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:03 smithi040 bash[35794]: cluster 2024-02-10T08:51:02.389286+0000 mgr.x (mgr.34640) 181 : cluster [DBG] pgmap v163: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:03.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:03 smithi040 bash[38951]: cluster 2024-02-10T08:51:02.389286+0000 mgr.x (mgr.34640) 181 : cluster [DBG] pgmap v163: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:05 smithi145 bash[35820]: cluster 2024-02-10T08:51:04.389999+0000 mgr.x (mgr.34640) 182 : cluster [DBG] pgmap v164: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:05.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:05 smithi040 bash[35794]: cluster 2024-02-10T08:51:04.389999+0000 mgr.x (mgr.34640) 182 : cluster [DBG] pgmap v164: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:05.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:05 smithi040 bash[38951]: cluster 2024-02-10T08:51:04.389999+0000 mgr.x (mgr.34640) 182 : cluster [DBG] pgmap v164: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:07 smithi040 bash[35794]: cluster 2024-02-10T08:51:06.390345+0000 mgr.x (mgr.34640) 183 : cluster [DBG] pgmap v165: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:07 smithi040 bash[38951]: cluster 2024-02-10T08:51:06.390345+0000 mgr.x (mgr.34640) 183 : cluster [DBG] pgmap v165: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:07 smithi145 bash[35820]: cluster 2024-02-10T08:51:06.390345+0000 mgr.x (mgr.34640) 183 : cluster [DBG] pgmap v165: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:09 smithi145 bash[35820]: cluster 2024-02-10T08:51:08.391091+0000 mgr.x (mgr.34640) 184 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:09.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:09 smithi040 bash[35794]: cluster 2024-02-10T08:51:08.391091+0000 mgr.x (mgr.34640) 184 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:09 smithi040 bash[38951]: cluster 2024-02-10T08:51:08.391091+0000 mgr.x (mgr.34640) 184 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:11 smithi145 bash[35820]: cluster 2024-02-10T08:51:10.391652+0000 mgr.x (mgr.34640) 185 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:11.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:11 smithi040 bash[35794]: cluster 2024-02-10T08:51:10.391652+0000 mgr.x (mgr.34640) 185 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:11.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:11 smithi040 bash[38951]: cluster 2024-02-10T08:51:10.391652+0000 mgr.x (mgr.34640) 185 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:13 smithi145 bash[35820]: cluster 2024-02-10T08:51:12.392075+0000 mgr.x (mgr.34640) 186 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:13.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:13 smithi040 bash[35794]: cluster 2024-02-10T08:51:12.392075+0000 mgr.x (mgr.34640) 186 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:13.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:13 smithi040 bash[38951]: cluster 2024-02-10T08:51:12.392075+0000 mgr.x (mgr.34640) 186 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:15 smithi145 bash[35820]: cluster 2024-02-10T08:51:14.392929+0000 mgr.x (mgr.34640) 187 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:15.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:15 smithi040 bash[35794]: cluster 2024-02-10T08:51:14.392929+0000 mgr.x (mgr.34640) 187 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:15.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:15 smithi040 bash[38951]: cluster 2024-02-10T08:51:14.392929+0000 mgr.x (mgr.34640) 187 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:17 smithi040 bash[35794]: cluster 2024-02-10T08:51:16.393307+0000 mgr.x (mgr.34640) 188 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:17 smithi040 bash[38951]: cluster 2024-02-10T08:51:16.393307+0000 mgr.x (mgr.34640) 188 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:17 smithi145 bash[35820]: cluster 2024-02-10T08:51:16.393307+0000 mgr.x (mgr.34640) 188 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:19 smithi145 bash[35820]: cluster 2024-02-10T08:51:18.394076+0000 mgr.x (mgr.34640) 189 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:19.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:19 smithi040 bash[35794]: cluster 2024-02-10T08:51:18.394076+0000 mgr.x (mgr.34640) 189 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:19.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:19 smithi040 bash[38951]: cluster 2024-02-10T08:51:18.394076+0000 mgr.x (mgr.34640) 189 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:21 smithi145 bash[35820]: cluster 2024-02-10T08:51:20.394576+0000 mgr.x (mgr.34640) 190 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:21.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:21 smithi040 bash[35794]: cluster 2024-02-10T08:51:20.394576+0000 mgr.x (mgr.34640) 190 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:21.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:21 smithi040 bash[38951]: cluster 2024-02-10T08:51:20.394576+0000 mgr.x (mgr.34640) 190 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:23 smithi145 bash[35820]: cluster 2024-02-10T08:51:22.395040+0000 mgr.x (mgr.34640) 191 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:23 smithi040 bash[35794]: cluster 2024-02-10T08:51:22.395040+0000 mgr.x (mgr.34640) 191 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:23 smithi040 bash[38951]: cluster 2024-02-10T08:51:22.395040+0000 mgr.x (mgr.34640) 191 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:25 smithi145 bash[35820]: cluster 2024-02-10T08:51:24.395901+0000 mgr.x (mgr.34640) 192 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:25.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:25 smithi040 bash[35794]: cluster 2024-02-10T08:51:24.395901+0000 mgr.x (mgr.34640) 192 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:25.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:25 smithi040 bash[38951]: cluster 2024-02-10T08:51:24.395901+0000 mgr.x (mgr.34640) 192 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:27 smithi040 bash[35794]: cluster 2024-02-10T08:51:26.396473+0000 mgr.x (mgr.34640) 193 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:27.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:27 smithi040 bash[38951]: cluster 2024-02-10T08:51:26.396473+0000 mgr.x (mgr.34640) 193 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:27 smithi145 bash[35820]: cluster 2024-02-10T08:51:26.396473+0000 mgr.x (mgr.34640) 193 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:29 smithi145 bash[35820]: cluster 2024-02-10T08:51:28.397178+0000 mgr.x (mgr.34640) 194 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:29.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:29 smithi040 bash[35794]: cluster 2024-02-10T08:51:28.397178+0000 mgr.x (mgr.34640) 194 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:29.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:29 smithi040 bash[38951]: cluster 2024-02-10T08:51:28.397178+0000 mgr.x (mgr.34640) 194 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:31 smithi145 bash[35820]: cluster 2024-02-10T08:51:30.397637+0000 mgr.x (mgr.34640) 195 : cluster [DBG] pgmap v177: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:31.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:31 smithi040 bash[35794]: cluster 2024-02-10T08:51:30.397637+0000 mgr.x (mgr.34640) 195 : cluster [DBG] pgmap v177: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:31.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:31 smithi040 bash[38951]: cluster 2024-02-10T08:51:30.397637+0000 mgr.x (mgr.34640) 195 : cluster [DBG] pgmap v177: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:33 smithi145 bash[35820]: cluster 2024-02-10T08:51:32.398201+0000 mgr.x (mgr.34640) 196 : cluster [DBG] pgmap v178: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:33.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:33 smithi040 bash[35794]: cluster 2024-02-10T08:51:32.398201+0000 mgr.x (mgr.34640) 196 : cluster [DBG] pgmap v178: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:33.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:33 smithi040 bash[38951]: cluster 2024-02-10T08:51:32.398201+0000 mgr.x (mgr.34640) 196 : cluster [DBG] pgmap v178: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:35 smithi145 bash[35820]: cluster 2024-02-10T08:51:34.398881+0000 mgr.x (mgr.34640) 197 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:35.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:35 smithi040 bash[35794]: cluster 2024-02-10T08:51:34.398881+0000 mgr.x (mgr.34640) 197 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:35.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:35 smithi040 bash[38951]: cluster 2024-02-10T08:51:34.398881+0000 mgr.x (mgr.34640) 197 : cluster [DBG] pgmap v179: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:37 smithi040 bash[35794]: cluster 2024-02-10T08:51:36.399290+0000 mgr.x (mgr.34640) 198 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:37 smithi040 bash[38951]: cluster 2024-02-10T08:51:36.399290+0000 mgr.x (mgr.34640) 198 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:37 smithi145 bash[35820]: cluster 2024-02-10T08:51:36.399290+0000 mgr.x (mgr.34640) 198 : cluster [DBG] pgmap v180: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:39 smithi145 bash[35820]: cluster 2024-02-10T08:51:38.399973+0000 mgr.x (mgr.34640) 199 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:39 smithi145 bash[35820]: audit 2024-02-10T08:51:38.637593+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:51:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:39 smithi145 bash[35820]: audit 2024-02-10T08:51:38.638095+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:51:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:39 smithi145 bash[35820]: audit 2024-02-10T08:51:38.640962+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:51:39.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[35794]: cluster 2024-02-10T08:51:38.399973+0000 mgr.x (mgr.34640) 199 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[35794]: audit 2024-02-10T08:51:38.637593+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[35794]: audit 2024-02-10T08:51:38.638095+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[35794]: audit 2024-02-10T08:51:38.640962+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[38951]: cluster 2024-02-10T08:51:38.399973+0000 mgr.x (mgr.34640) 199 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[38951]: audit 2024-02-10T08:51:38.637593+0000 mon.b (mon.2) 170 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[38951]: audit 2024-02-10T08:51:38.638095+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:51:39.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:39 smithi040 bash[38951]: audit 2024-02-10T08:51:38.640962+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:51:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:41 smithi145 bash[35820]: cluster 2024-02-10T08:51:40.400525+0000 mgr.x (mgr.34640) 200 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:41.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:41 smithi040 bash[35794]: cluster 2024-02-10T08:51:40.400525+0000 mgr.x (mgr.34640) 200 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:41 smithi040 bash[38951]: cluster 2024-02-10T08:51:40.400525+0000 mgr.x (mgr.34640) 200 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.359860+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.360117+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.360286+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.360478+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.360488+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.360970+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.361183+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-10T08:51:42.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:42 smithi145 bash[35820]: audit 2024-02-10T08:51:42.361382+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.359860+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.360117+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.360286+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.360478+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.360488+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.360970+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.361183+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[35794]: audit 2024-02-10T08:51:42.361382+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.359860+0000 mon.b (mon.2) 171 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.360117+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.360286+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-10T08:51:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.360478+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.360488+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T08:51:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.360970+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:51:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.361183+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2024-02-10T08:51:42.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:42 smithi040 bash[38951]: audit 2024-02-10T08:51:42.361382+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:51:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:43 smithi145 bash[35820]: cluster 2024-02-10T08:51:42.400933+0000 mgr.x (mgr.34640) 201 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:43 smithi040 bash[35794]: cluster 2024-02-10T08:51:42.400933+0000 mgr.x (mgr.34640) 201 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:43 smithi040 bash[38951]: cluster 2024-02-10T08:51:42.400933+0000 mgr.x (mgr.34640) 201 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:45 smithi145 bash[35820]: cluster 2024-02-10T08:51:44.401814+0000 mgr.x (mgr.34640) 202 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:45.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:45 smithi040 bash[35794]: cluster 2024-02-10T08:51:44.401814+0000 mgr.x (mgr.34640) 202 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:45.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:45 smithi040 bash[38951]: cluster 2024-02-10T08:51:44.401814+0000 mgr.x (mgr.34640) 202 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:47 smithi040 bash[35794]: cluster 2024-02-10T08:51:46.402365+0000 mgr.x (mgr.34640) 203 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:47 smithi040 bash[38951]: cluster 2024-02-10T08:51:46.402365+0000 mgr.x (mgr.34640) 203 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:47 smithi145 bash[35820]: cluster 2024-02-10T08:51:46.402365+0000 mgr.x (mgr.34640) 203 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:49 smithi145 bash[35820]: cluster 2024-02-10T08:51:48.403133+0000 mgr.x (mgr.34640) 204 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:49.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:49 smithi040 bash[35794]: cluster 2024-02-10T08:51:48.403133+0000 mgr.x (mgr.34640) 204 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:49.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:49 smithi040 bash[38951]: cluster 2024-02-10T08:51:48.403133+0000 mgr.x (mgr.34640) 204 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:50.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T08:51:51.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:51 smithi040 bash[35794]: cluster 2024-02-10T08:51:50.403592+0000 mgr.x (mgr.34640) 205 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:51.732 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:51 smithi040 bash[38951]: cluster 2024-02-10T08:51:50.403592+0000 mgr.x (mgr.34640) 205 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:51 smithi145 bash[35820]: cluster 2024-02-10T08:51:50.403592+0000 mgr.x (mgr.34640) 205 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (5m) 74s ago 15m 17.2M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (15m) 2m ago 15m 34.7M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (9m) 2m ago 18m 422M - 16.2.14-521-g0e714d9a 1fbc92c859dc b9b23ff414a1 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (2m) 74s ago 20m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (20m) 74s ago 20m 115M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:51:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (19m) 2m ago 19m 122M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (19m) 74s ago 19m 118M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (15m) 74s ago 15m 13.9M - 1.7.0 72c9c2088986 499f0f53e04a 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (15m) 2m ago 15m 13.3M - 1.7.0 72c9c2088986 b3a2408fef6b 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (18m) 74s ago 18m 47.2M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (18m) 74s ago 18m 44.5M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (17m) 74s ago 17m 44.7M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (17m) 74s ago 17m 48.1M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (17m) 2m ago 17m 46.1M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (16m) 2m ago 17m 44.3M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (16m) 2m ago 16m 43.7M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (16m) 2m ago 16m 45.2M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (5m) 2m ago 15m 48.3M - 2.49.1 2a72b385beaf 37cd9848751b 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (13m) 74s ago 13m 35.1M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:51:52.613 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (13m) 2m ago 13m 35.1M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:51:53.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T08:51:53.599 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: cluster 2024-02-10T08:51:52.404021+0000 mgr.x (mgr.34640) 206 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:53.599 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.601165+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.599 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.601631+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.599 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.601992+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.602378+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.602731+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.603072+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.605135+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.605517+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.605877+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.606218+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[35794]: audit 2024-02-10T08:51:52.606569+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.600 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: cluster 2024-02-10T08:51:52.404021+0000 mgr.x (mgr.34640) 206 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.601165+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.601631+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.601992+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.602378+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.602731+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.603072+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.605135+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.605517+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.605877+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.606218+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.601 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:53 smithi040 bash[38951]: audit 2024-02-10T08:51:52.606569+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: cluster 2024-02-10T08:51:52.404021+0000 mgr.x (mgr.34640) 206 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.601165+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.601631+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.601992+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.602378+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.602731+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.603072+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.605135+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:51:53.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.605517+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.605877+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.606218+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:53.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:53 smithi145 bash[35820]: audit 2024-02-10T08:51:52.606569+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:51:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:54 smithi145 bash[35820]: audit 2024-02-10T08:51:52.598952+0000 mgr.x (mgr.34640) 207 : audit [DBG] from='client.24718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:51:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:54 smithi040 bash[35794]: audit 2024-02-10T08:51:52.598952+0000 mgr.x (mgr.34640) 207 : audit [DBG] from='client.24718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:51:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:54 smithi040 bash[38951]: audit 2024-02-10T08:51:52.598952+0000 mgr.x (mgr.34640) 207 : audit [DBG] from='client.24718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:51:55.313 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:51:55.313 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:51:55.314 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T08:51:55.315 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:51:55.315 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:51:55.315 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:51:55.668 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:55 smithi040 bash[35794]: cluster 2024-02-10T08:51:54.404848+0000 mgr.x (mgr.34640) 208 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:55.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:55 smithi040 bash[35794]: audit 2024-02-10T08:51:55.313516+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.15.40:0/3460569921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:51:55.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:55 smithi040 bash[38951]: cluster 2024-02-10T08:51:54.404848+0000 mgr.x (mgr.34640) 208 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:55.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:55 smithi040 bash[38951]: audit 2024-02-10T08:51:55.313516+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.15.40:0/3460569921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:51:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:55 smithi145 bash[35820]: cluster 2024-02-10T08:51:54.404848+0000 mgr.x (mgr.34640) 208 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:55 smithi145 bash[35820]: audit 2024-02-10T08:51:55.313516+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.15.40:0/3460569921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:51:55.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph -s' 2024-02-10T08:51:57.497 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:57 smithi040 bash[35794]: cluster 2024-02-10T08:51:56.405214+0000 mgr.x (mgr.34640) 209 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:57.497 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:57 smithi040 bash[38951]: cluster 2024-02-10T08:51:56.405214+0000 mgr.x (mgr.34640) 209 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:57 smithi145 bash[35820]: cluster 2024-02-10T08:51:56.405214+0000 mgr.x (mgr.34640) 209 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:57.971 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: id: a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 19m) 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: x(active, since 6m), standbys: y 2024-02-10T08:51:57.972 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 16m), 8 in (since 16m) 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.skjeib, r.z.smithi145.uizklq) 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 5 pools, 129 pgs 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.0 KiB 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:57.973 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 129 active+clean 2024-02-10T08:51:57.974 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:51:58.588 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:58 smithi040 bash[35794]: audit 2024-02-10T08:51:57.971207+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.15.40:0/4006734471' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:51:58.588 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:58 smithi040 bash[38951]: audit 2024-02-10T08:51:57.971207+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.15.40:0/4006734471' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:51:58.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph mgr fail' 2024-02-10T08:51:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:58 smithi145 bash[35820]: audit 2024-02-10T08:51:57.971207+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.15.40:0/4006734471' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:51:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:51:59 smithi040 bash[35794]: cluster 2024-02-10T08:51:58.405972+0000 mgr.x (mgr.34640) 210 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:59.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:51:59 smithi040 bash[38951]: cluster 2024-02-10T08:51:58.405972+0000 mgr.x (mgr.34640) 210 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:51:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:51:59 smithi145 bash[35820]: cluster 2024-02-10T08:51:58.405972+0000 mgr.x (mgr.34640) 210 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:01.739 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: cluster 2024-02-10T08:52:00.406533+0000 mgr.x (mgr.34640) 211 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: audit 2024-02-10T08:52:00.502239+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.40:0/527689411' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: audit 2024-02-10T08:52:00.502456+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: cluster 2024-02-10T08:52:00.507994+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: audit 2024-02-10T08:52:00.509900+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: audit 2024-02-10T08:52:00.511131+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: audit 2024-02-10T08:52:00.512127+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: audit 2024-02-10T08:52:00.512363+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[35794]: cluster 2024-02-10T08:52:00.933875+0000 mon.a (mon.0) 706 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: cluster 2024-02-10T08:52:00.406533+0000 mgr.x (mgr.34640) 211 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:01.740 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: audit 2024-02-10T08:52:00.502239+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.40:0/527689411' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: audit 2024-02-10T08:52:00.502456+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: cluster 2024-02-10T08:52:00.507994+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: audit 2024-02-10T08:52:00.509900+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: audit 2024-02-10T08:52:00.511131+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: audit 2024-02-10T08:52:00.512127+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: audit 2024-02-10T08:52:00.512363+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:52:01.741 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:01 smithi040 bash[38951]: cluster 2024-02-10T08:52:00.933875+0000 mon.a (mon.0) 706 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:52:01.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[48458]: debug 2024-02-10T08:52:01.466+0000 7ff263887700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-10T08:52:01.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[48458]: ignoring --setuser ceph since I am not root 2024-02-10T08:52:01.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[48458]: ignoring --setgroup ceph since I am not root 2024-02-10T08:52:01.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[48458]: debug 2024-02-10T08:52:01.511+0000 7f0b83d04700 1 -- 172.21.15.145:0/2029986763 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d3132e24e0 con 0x55d3132b9400 2024-02-10T08:52:01.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[48458]: debug 2024-02-10T08:52:01.633+0000 7f0b93ee2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[48458]: debug 2024-02-10T08:52:01.713+0000 7f0b93ee2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: cluster 2024-02-10T08:52:00.406533+0000 mgr.x (mgr.34640) 211 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: audit 2024-02-10T08:52:00.502239+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.40:0/527689411' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: audit 2024-02-10T08:52:00.502456+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: cluster 2024-02-10T08:52:00.507994+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: audit 2024-02-10T08:52:00.509900+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: audit 2024-02-10T08:52:00.511131+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: audit 2024-02-10T08:52:00.512127+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34640 172.21.15.145:0/1567729811' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: audit 2024-02-10T08:52:00.512363+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:52:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:01 smithi145 bash[35820]: cluster 2024-02-10T08:52:00.933875+0000 mon.a (mon.0) 706 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:52:02.040 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 180' 2024-02-10T08:52:02.475 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[48458]: debug 2024-02-10T08:52:02.073+0000 7f0b93ee2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:52:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[35794]: audit 2024-02-10T08:52:01.466028+0000 mon.a (mon.0) 707 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[35794]: cluster 2024-02-10T08:52:01.466163+0000 mon.a (mon.0) 708 : cluster [DBG] mgrmap e21: y(active, starting, since 0.963301s), standbys: x 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[35794]: audit 2024-02-10T08:52:01.510058+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[35794]: cluster 2024-02-10T08:52:01.510132+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[38951]: audit 2024-02-10T08:52:01.466028+0000 mon.a (mon.0) 707 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[38951]: cluster 2024-02-10T08:52:01.466163+0000 mon.a (mon.0) 708 : cluster [DBG] mgrmap e21: y(active, starting, since 0.963301s), standbys: x 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[38951]: audit 2024-02-10T08:52:01.510058+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:52:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:02 smithi040 bash[38951]: cluster 2024-02-10T08:52:01.510132+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-10T08:52:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[35820]: audit 2024-02-10T08:52:01.466028+0000 mon.a (mon.0) 707 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:52:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[35820]: cluster 2024-02-10T08:52:01.466163+0000 mon.a (mon.0) 708 : cluster [DBG] mgrmap e21: y(active, starting, since 0.963301s), standbys: x 2024-02-10T08:52:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[35820]: audit 2024-02-10T08:52:01.510058+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34640 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:52:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[35820]: cluster 2024-02-10T08:52:01.510132+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-10T08:52:03.110 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[48458]: debug 2024-02-10T08:52:02.816+0000 7f0b93ee2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:52:03.110 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:02 smithi145 bash[48458]: debug 2024-02-10T08:52:02.899+0000 7f0b93ee2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:52:03.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:03 smithi145 bash[48458]: debug 2024-02-10T08:52:03.109+0000 7f0b93ee2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:52:04.331 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.035+0000 7f0b93ee2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:52:04.332 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.162+0000 7f0b93ee2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:52:04.332 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.241+0000 7f0b93ee2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:52:04.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.330+0000 7f0b93ee2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:52:04.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.525+0000 7f0b93ee2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:52:05.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.803+0000 7f0b93ee2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:52:05.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:04 smithi145 bash[48458]: debug 2024-02-10T08:52:04.901+0000 7f0b93ee2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:52:05.960 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:05 smithi145 bash[48458]: debug 2024-02-10T08:52:05.615+0000 7f0b93ee2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:52:05.960 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:05 smithi145 bash[48458]: debug 2024-02-10T08:52:05.696+0000 7f0b93ee2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:52:05.960 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:05 smithi145 bash[48458]: debug 2024-02-10T08:52:05.787+0000 7f0b93ee2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:52:06.220 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:05 smithi145 bash[48458]: debug 2024-02-10T08:52:05.959+0000 7f0b93ee2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:52:06.487 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:06 smithi145 bash[48458]: debug 2024-02-10T08:52:06.219+0000 7f0b93ee2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:52:06.488 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:06 smithi145 bash[48458]: debug 2024-02-10T08:52:06.352+0000 7f0b93ee2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:52:06.742 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:06 smithi145 bash[48458]: debug 2024-02-10T08:52:06.486+0000 7f0b93ee2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:52:06.742 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:06 smithi145 bash[48458]: debug 2024-02-10T08:52:06.658+0000 7f0b93ee2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:52:07.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:52:06 smithi145 bash[48458]: debug 2024-02-10T08:52:06.741+0000 7f0b93ee2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:52:07.669 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:07 smithi145 bash[35820]: cluster 2024-02-10T08:52:06.744348+0000 mon.a (mon.0) 711 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:52:07.670 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:07 smithi145 bash[35820]: cluster 2024-02-10T08:52:06.744481+0000 mon.a (mon.0) 712 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:52:07.670 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:07 smithi145 bash[35820]: audit 2024-02-10T08:52:06.744643+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:52:07.670 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:07 smithi145 bash[35820]: audit 2024-02-10T08:52:06.744987+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:52:07.670 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:07 smithi145 bash[35820]: audit 2024-02-10T08:52:06.745897+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:52:07.670 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:07 smithi145 bash[35820]: audit 2024-02-10T08:52:06.746144+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:52:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[38951]: cluster 2024-02-10T08:52:06.744348+0000 mon.a (mon.0) 711 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:52:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[38951]: cluster 2024-02-10T08:52:06.744481+0000 mon.a (mon.0) 712 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:52:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[38951]: audit 2024-02-10T08:52:06.744643+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:52:07.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[38951]: audit 2024-02-10T08:52:06.744987+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[38951]: audit 2024-02-10T08:52:06.745897+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[38951]: audit 2024-02-10T08:52:06.746144+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[35794]: cluster 2024-02-10T08:52:06.744348+0000 mon.a (mon.0) 711 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[35794]: cluster 2024-02-10T08:52:06.744481+0000 mon.a (mon.0) 712 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[35794]: audit 2024-02-10T08:52:06.744643+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[35794]: audit 2024-02-10T08:52:06.744987+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[35794]: audit 2024-02-10T08:52:06.745897+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:52:07.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:07 smithi040 bash[35794]: audit 2024-02-10T08:52:06.746144+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:52:08.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:52:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: [80B blob data] 2024-02-10T08:52:08.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:52:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: [79B blob data] 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: cluster 2024-02-10T08:52:07.341991+0000 mon.a (mon.0) 713 : cluster [DBG] mgrmap e22: y(active, starting, since 6s), standbys: x 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.346326+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.346609+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.472785+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.472945+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.473188+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.474981+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.475301+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.475568+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.475807+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:52:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.476128+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.476348+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.476666+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.477059+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.477419+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.477650+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.478419+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.479238+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.480099+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: cluster 2024-02-10T08:52:07.341991+0000 mon.a (mon.0) 713 : cluster [DBG] mgrmap e22: y(active, starting, since 6s), standbys: x 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.346326+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:52:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.346609+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.472785+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.472945+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.473188+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.474981+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.475301+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.475568+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.475807+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.476128+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.476348+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.476666+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.477059+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.477419+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.477650+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.478419+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.479238+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:52:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.480099+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.480515+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.480915+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.481311+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.481703+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.482124+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.482500+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.482872+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.483253+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.483628+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.484039+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:52:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.484471+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:52:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.484864+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:52:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.485261+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:52:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.485649+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:52:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.486038+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:52:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.486424+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:52:08.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.480515+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.480915+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.481311+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.481703+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.482124+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.482500+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.482872+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.483253+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.483628+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.484039+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.484471+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.484864+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.485261+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.485649+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.486038+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:52:08.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.486424+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.486798+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.487184+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.487559+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.487940+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.488324+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: cluster 2024-02-10T08:52:07.515269+0000 mon.a (mon.0) 714 : cluster [INF] Manager daemon y is now available 2024-02-10T08:52:08.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.527770+0000 mon.c (mon.1) 84 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.528133+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.531375+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.632100+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.675638+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.676607+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.683553+0000 mon.c (mon.1) 87 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.684241+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:07.845204+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:08.100310+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.486798+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:52:08.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.487184+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.487559+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.487940+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.488324+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: cluster 2024-02-10T08:52:07.515269+0000 mon.a (mon.0) 714 : cluster [INF] Manager daemon y is now available 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.527770+0000 mon.c (mon.1) 84 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.528133+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.531375+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.632100+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.675638+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.676607+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.683553+0000 mon.c (mon.1) 87 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.684241+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:52:08.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:07.845204+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:52:08.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:08.100829+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:08.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:08.100310+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:08.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:08.103939+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:08.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[38951]: audit 2024-02-10T08:52:08.104836+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:52:08.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:08.100829+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:08.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:08.103939+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:08.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:08 smithi040 bash[35794]: audit 2024-02-10T08:52:08.104836+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:52:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: cluster 2024-02-10T08:52:07.341991+0000 mon.a (mon.0) 713 : cluster [DBG] mgrmap e22: y(active, starting, since 6s), standbys: x 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.346326+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.346609+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.? 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.472785+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.472945+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.473188+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.474981+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.475301+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.475568+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:52:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.475807+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.476128+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.476348+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.476666+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.477059+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.477419+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.477650+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.478419+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.479238+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.480099+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.480515+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.480915+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.481311+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.481703+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.482124+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:52:08.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.482500+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.482872+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.483253+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.483628+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.484039+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.484471+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.484864+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.485261+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.485649+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.486038+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.486424+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:52:08.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.486798+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.487184+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.487559+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.487940+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.488324+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: cluster 2024-02-10T08:52:07.515269+0000 mon.a (mon.0) 714 : cluster [INF] Manager daemon y is now available 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.527770+0000 mon.c (mon.1) 84 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.528133+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.531375+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi040\": {\"hostname\": \"smithi040\", \"addr\": \"172.21.15.40\", \"labels\": [], \"status\": \"\"}, \"smithi145\": {\"hostname\": \"smithi145\", \"addr\": \"172.21.15.145\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.632100+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.675638+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.676607+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.683553+0000 mon.c (mon.1) 87 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:52:08.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.684241+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:52:08.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:07.845204+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:52:08.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:08.100310+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:08.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:08.100829+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:08.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:08.103939+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 121425100, \"cpu_percentage\": \"1.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030478Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404226048, \"cpu_percentage\": \"10.37%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:50:38.030669Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 124570828, \"cpu_percentage\": \"0.74%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030756Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49492787, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030835Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46693089, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030912Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46871347, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.030989Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50520391, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031066Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031142Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18119393, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031219Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 36878417, \"cpu_percentage\": \"0.15%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:50:38.031294Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:08.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:08 smithi145 bash[35820]: audit 2024-02-10T08:52:08.104836+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:52:09.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:09 smithi040 bash[35794]: cephadm 2024-02-10T08:52:07.527350+0000 mgr.y (mgr.24712) 1 : cephadm [INF] inventory: adjusted host smithi145 addr 'smithi145' -> '172.21.15.145' 2024-02-10T08:52:09.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:09 smithi040 bash[35794]: cluster 2024-02-10T08:52:08.353287+0000 mon.a (mon.0) 721 : cluster [DBG] mgrmap e23: y(active, since 7s), standbys: x 2024-02-10T08:52:09.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:09 smithi040 bash[35794]: cluster 2024-02-10T08:52:08.369356+0000 mgr.y (mgr.24712) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:09 smithi040 bash[38951]: cephadm 2024-02-10T08:52:07.527350+0000 mgr.y (mgr.24712) 1 : cephadm [INF] inventory: adjusted host smithi145 addr 'smithi145' -> '172.21.15.145' 2024-02-10T08:52:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:09 smithi040 bash[38951]: cluster 2024-02-10T08:52:08.353287+0000 mon.a (mon.0) 721 : cluster [DBG] mgrmap e23: y(active, since 7s), standbys: x 2024-02-10T08:52:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:09 smithi040 bash[38951]: cluster 2024-02-10T08:52:08.369356+0000 mgr.y (mgr.24712) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:09.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:09 smithi145 bash[35820]: cephadm 2024-02-10T08:52:07.527350+0000 mgr.y (mgr.24712) 1 : cephadm [INF] inventory: adjusted host smithi145 addr 'smithi145' -> '172.21.15.145' 2024-02-10T08:52:09.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:09 smithi145 bash[35820]: cluster 2024-02-10T08:52:08.353287+0000 mon.a (mon.0) 721 : cluster [DBG] mgrmap e23: y(active, since 7s), standbys: x 2024-02-10T08:52:09.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:09 smithi145 bash[35820]: cluster 2024-02-10T08:52:08.369356+0000 mgr.y (mgr.24712) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:11 smithi040 bash[35794]: cluster 2024-02-10T08:52:09.476912+0000 mgr.y (mgr.24712) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:11 smithi040 bash[38951]: cluster 2024-02-10T08:52:09.476912+0000 mgr.y (mgr.24712) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:11 smithi145 bash[35820]: cluster 2024-02-10T08:52:09.476912+0000 mgr.y (mgr.24712) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:13.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: cluster 2024-02-10T08:52:11.477312+0000 mgr.y (mgr.24712) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: cluster 2024-02-10T08:52:11.477312+0000 mgr.y (mgr.24712) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:13.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.539415+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:13.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.539415+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:13.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.539945+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:13.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.539945+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:13.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.543078+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:13.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.833919+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.834308+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.834635+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.834955+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.835263+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.835575+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.835862+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.836157+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[35794]: audit 2024-02-10T08:52:12.836444+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.543078+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.833919+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.834308+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.834635+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.834955+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.835263+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.835575+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.835862+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.836157+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:13 smithi040 bash[38951]: audit 2024-02-10T08:52:12.836444+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: cluster 2024-02-10T08:52:11.477312+0000 mgr.y (mgr.24712) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.539415+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.539945+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.543078+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 152148377, \"cpu_percentage\": \"1.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537487Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428972441, \"cpu_percentage\": \"4.91%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:52:12.537659Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 128869990, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537736Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537803Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46902804, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537868Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47259320, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537932Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.537996Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14344519, \"cpu_percentage\": \"0.32%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538059Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18129879, \"cpu_percentage\": \"0.12%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538140Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37413191, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:12.538204Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:12.538323Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.833919+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.834308+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.834635+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.834955+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.835263+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.835575+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.835862+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:13.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.836157+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:13.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:13 smithi145 bash[35820]: audit 2024-02-10T08:52:12.836444+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.480788+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:14.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.480788+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:14.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.481408+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:14.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.481408+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:14.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.488471+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:14.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.767447+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.768007+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.768473+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.768917+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.769371+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.769815+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.770263+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.770694+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.771148+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.772834+0000 mon.c (mon.1) 111 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.773202+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.779903+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.787695+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.788007+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[35794]: audit 2024-02-10T08:52:13.794174+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:52:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.488471+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.767447+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.768007+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.768473+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.768917+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.769371+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.769815+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.770263+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.770694+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.771148+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.772834+0000 mon.c (mon.1) 111 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.773202+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.779903+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.787695+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.788007+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:14 smithi040 bash[38951]: audit 2024-02-10T08:52:13.794174+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.480788+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.481408+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.488471+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 132540006, \"cpu_percentage\": \"0.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.477841Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399612313, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478035Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48758784, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478199Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47154462, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478301Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46483374, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478494Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47993323, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478664Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 53141831, \"cpu_percentage\": \"0.32%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478819Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14281605, \"cpu_percentage\": \"0.30%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.478963Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36700160, \"cpu_percentage\": \"0.39%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479122Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38031851, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:52:13.479267Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:52:13.479433Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.767447+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.768007+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.768473+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.768917+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.769371+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.769815+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.770263+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.770694+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.771148+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.772834+0000 mon.c (mon.1) 111 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.773202+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.779903+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.787695+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.788007+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:52:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:14 smithi145 bash[35820]: audit 2024-02-10T08:52:13.794174+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:52:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:15 smithi040 bash[35794]: cluster 2024-02-10T08:52:13.477913+0000 mgr.y (mgr.24712) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:15.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:15 smithi040 bash[38951]: cluster 2024-02-10T08:52:13.477913+0000 mgr.y (mgr.24712) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:15 smithi145 bash[35820]: cluster 2024-02-10T08:52:13.477913+0000 mgr.y (mgr.24712) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:17 smithi040 bash[35794]: cluster 2024-02-10T08:52:15.478369+0000 mgr.y (mgr.24712) 6 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:17 smithi040 bash[38951]: cluster 2024-02-10T08:52:15.478369+0000 mgr.y (mgr.24712) 6 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:17 smithi145 bash[35820]: cluster 2024-02-10T08:52:15.478369+0000 mgr.y (mgr.24712) 6 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:19 smithi040 bash[35794]: cluster 2024-02-10T08:52:17.478726+0000 mgr.y (mgr.24712) 7 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:19 smithi040 bash[38951]: cluster 2024-02-10T08:52:17.478726+0000 mgr.y (mgr.24712) 7 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:19 smithi145 bash[35820]: cluster 2024-02-10T08:52:17.478726+0000 mgr.y (mgr.24712) 7 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:20 smithi040 bash[35794]: cluster 2024-02-10T08:52:19.479439+0000 mgr.y (mgr.24712) 8 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:20.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:20 smithi040 bash[38951]: cluster 2024-02-10T08:52:19.479439+0000 mgr.y (mgr.24712) 8 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:20 smithi145 bash[35820]: cluster 2024-02-10T08:52:19.479439+0000 mgr.y (mgr.24712) 8 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:23.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:23 smithi040 bash[35794]: cluster 2024-02-10T08:52:21.479896+0000 mgr.y (mgr.24712) 9 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:23.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:23 smithi040 bash[38951]: cluster 2024-02-10T08:52:21.479896+0000 mgr.y (mgr.24712) 9 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:23 smithi145 bash[35820]: cluster 2024-02-10T08:52:21.479896+0000 mgr.y (mgr.24712) 9 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:25 smithi040 bash[35794]: cluster 2024-02-10T08:52:23.480542+0000 mgr.y (mgr.24712) 10 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:25 smithi040 bash[38951]: cluster 2024-02-10T08:52:23.480542+0000 mgr.y (mgr.24712) 10 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:25 smithi145 bash[35820]: cluster 2024-02-10T08:52:23.480542+0000 mgr.y (mgr.24712) 10 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:27.343 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:52:26 smithi040 bash[59999]: ts=2024-02-10T08:52:26.951Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="web.hook/webhook[0]: notify retry canceled after 16 attempts: Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:52:27.344 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:52:26 smithi040 bash[59999]: ts=2024-02-10T08:52:26.952Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:52:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:27 smithi040 bash[35794]: cluster 2024-02-10T08:52:25.481047+0000 mgr.y (mgr.24712) 11 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:27.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:27 smithi040 bash[38951]: cluster 2024-02-10T08:52:25.481047+0000 mgr.y (mgr.24712) 11 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:27 smithi145 bash[35820]: cluster 2024-02-10T08:52:25.481047+0000 mgr.y (mgr.24712) 11 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:29 smithi040 bash[35794]: cluster 2024-02-10T08:52:27.481621+0000 mgr.y (mgr.24712) 12 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:29 smithi040 bash[38951]: cluster 2024-02-10T08:52:27.481621+0000 mgr.y (mgr.24712) 12 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:29 smithi145 bash[35820]: cluster 2024-02-10T08:52:27.481621+0000 mgr.y (mgr.24712) 12 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:31 smithi040 bash[35794]: cluster 2024-02-10T08:52:29.482253+0000 mgr.y (mgr.24712) 13 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:31.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:31 smithi040 bash[38951]: cluster 2024-02-10T08:52:29.482253+0000 mgr.y (mgr.24712) 13 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:31 smithi145 bash[35820]: cluster 2024-02-10T08:52:29.482253+0000 mgr.y (mgr.24712) 13 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:33.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:33 smithi040 bash[35794]: cluster 2024-02-10T08:52:31.482723+0000 mgr.y (mgr.24712) 14 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:33 smithi040 bash[38951]: cluster 2024-02-10T08:52:31.482723+0000 mgr.y (mgr.24712) 14 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:33 smithi145 bash[35820]: cluster 2024-02-10T08:52:31.482723+0000 mgr.y (mgr.24712) 14 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:35.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:35 smithi040 bash[35794]: cluster 2024-02-10T08:52:33.483624+0000 mgr.y (mgr.24712) 15 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:35 smithi040 bash[38951]: cluster 2024-02-10T08:52:33.483624+0000 mgr.y (mgr.24712) 15 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:35 smithi145 bash[35820]: cluster 2024-02-10T08:52:33.483624+0000 mgr.y (mgr.24712) 15 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:37 smithi040 bash[35794]: cluster 2024-02-10T08:52:35.484021+0000 mgr.y (mgr.24712) 16 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:37 smithi040 bash[38951]: cluster 2024-02-10T08:52:35.484021+0000 mgr.y (mgr.24712) 16 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:37 smithi145 bash[35820]: cluster 2024-02-10T08:52:35.484021+0000 mgr.y (mgr.24712) 16 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:39 smithi040 bash[35794]: cluster 2024-02-10T08:52:37.484458+0000 mgr.y (mgr.24712) 17 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:39 smithi040 bash[38951]: cluster 2024-02-10T08:52:37.484458+0000 mgr.y (mgr.24712) 17 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:39 smithi145 bash[35820]: cluster 2024-02-10T08:52:37.484458+0000 mgr.y (mgr.24712) 17 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:41 smithi040 bash[35794]: cluster 2024-02-10T08:52:39.485237+0000 mgr.y (mgr.24712) 18 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:41 smithi040 bash[38951]: cluster 2024-02-10T08:52:39.485237+0000 mgr.y (mgr.24712) 18 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:41 smithi145 bash[35820]: cluster 2024-02-10T08:52:39.485237+0000 mgr.y (mgr.24712) 18 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:43.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:43 smithi040 bash[38951]: cluster 2024-02-10T08:52:41.485650+0000 mgr.y (mgr.24712) 19 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:43.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:43 smithi040 bash[35794]: cluster 2024-02-10T08:52:41.485650+0000 mgr.y (mgr.24712) 19 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:43 smithi145 bash[35820]: cluster 2024-02-10T08:52:41.485650+0000 mgr.y (mgr.24712) 19 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:45 smithi040 bash[35794]: cluster 2024-02-10T08:52:43.486597+0000 mgr.y (mgr.24712) 20 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:45 smithi040 bash[38951]: cluster 2024-02-10T08:52:43.486597+0000 mgr.y (mgr.24712) 20 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:45 smithi145 bash[35820]: cluster 2024-02-10T08:52:43.486597+0000 mgr.y (mgr.24712) 20 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:47.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:47 smithi040 bash[35794]: cluster 2024-02-10T08:52:45.487101+0000 mgr.y (mgr.24712) 21 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:47 smithi040 bash[38951]: cluster 2024-02-10T08:52:45.487101+0000 mgr.y (mgr.24712) 21 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:47 smithi145 bash[35820]: cluster 2024-02-10T08:52:45.487101+0000 mgr.y (mgr.24712) 21 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:49 smithi040 bash[35794]: cluster 2024-02-10T08:52:47.487583+0000 mgr.y (mgr.24712) 22 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:49 smithi040 bash[38951]: cluster 2024-02-10T08:52:47.487583+0000 mgr.y (mgr.24712) 22 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:49 smithi145 bash[35820]: cluster 2024-02-10T08:52:47.487583+0000 mgr.y (mgr.24712) 22 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:51 smithi040 bash[35794]: cluster 2024-02-10T08:52:49.488297+0000 mgr.y (mgr.24712) 23 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:51 smithi040 bash[38951]: cluster 2024-02-10T08:52:49.488297+0000 mgr.y (mgr.24712) 23 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:51 smithi145 bash[35820]: cluster 2024-02-10T08:52:49.488297+0000 mgr.y (mgr.24712) 23 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:53 smithi040 bash[35794]: cluster 2024-02-10T08:52:51.488729+0000 mgr.y (mgr.24712) 24 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:53 smithi040 bash[38951]: cluster 2024-02-10T08:52:51.488729+0000 mgr.y (mgr.24712) 24 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:53.677 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:52:53 smithi040 bash[59999]: ts=2024-02-10T08:52:53.248Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="web.hook/webhook[0]: notify retry canceled after 17 attempts: Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:52:53.677 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:52:53 smithi040 bash[59999]: ts=2024-02-10T08:52:53.249Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephMgrPrometheusModuleInactive\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:52:53.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:53 smithi145 bash[35820]: cluster 2024-02-10T08:52:51.488729+0000 mgr.y (mgr.24712) 24 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:55 smithi040 bash[35794]: cluster 2024-02-10T08:52:53.489669+0000 mgr.y (mgr.24712) 25 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:55 smithi040 bash[38951]: cluster 2024-02-10T08:52:53.489669+0000 mgr.y (mgr.24712) 25 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:55 smithi145 bash[35820]: cluster 2024-02-10T08:52:53.489669+0000 mgr.y (mgr.24712) 25 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:57 smithi040 bash[35794]: cluster 2024-02-10T08:52:55.490117+0000 mgr.y (mgr.24712) 26 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:57 smithi040 bash[38951]: cluster 2024-02-10T08:52:55.490117+0000 mgr.y (mgr.24712) 26 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:57 smithi145 bash[35820]: cluster 2024-02-10T08:52:55.490117+0000 mgr.y (mgr.24712) 26 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:52:59 smithi040 bash[35794]: cluster 2024-02-10T08:52:57.490584+0000 mgr.y (mgr.24712) 27 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:52:59 smithi040 bash[38951]: cluster 2024-02-10T08:52:57.490584+0000 mgr.y (mgr.24712) 27 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:52:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:52:59 smithi145 bash[35820]: cluster 2024-02-10T08:52:57.490584+0000 mgr.y (mgr.24712) 27 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:01 smithi040 bash[35794]: cluster 2024-02-10T08:52:59.491273+0000 mgr.y (mgr.24712) 28 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:01 smithi040 bash[38951]: cluster 2024-02-10T08:52:59.491273+0000 mgr.y (mgr.24712) 28 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:01 smithi145 bash[35820]: cluster 2024-02-10T08:52:59.491273+0000 mgr.y (mgr.24712) 28 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:03.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:03 smithi040 bash[35794]: cluster 2024-02-10T08:53:01.491776+0000 mgr.y (mgr.24712) 29 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:03.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:03 smithi040 bash[38951]: cluster 2024-02-10T08:53:01.491776+0000 mgr.y (mgr.24712) 29 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:03 smithi145 bash[35820]: cluster 2024-02-10T08:53:01.491776+0000 mgr.y (mgr.24712) 29 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:05.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:05 smithi040 bash[35794]: cluster 2024-02-10T08:53:03.492444+0000 mgr.y (mgr.24712) 30 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:05.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:05 smithi040 bash[38951]: cluster 2024-02-10T08:53:03.492444+0000 mgr.y (mgr.24712) 30 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:05 smithi145 bash[35820]: cluster 2024-02-10T08:53:03.492444+0000 mgr.y (mgr.24712) 30 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:07 smithi040 bash[35794]: cluster 2024-02-10T08:53:05.492977+0000 mgr.y (mgr.24712) 31 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:07 smithi040 bash[38951]: cluster 2024-02-10T08:53:05.492977+0000 mgr.y (mgr.24712) 31 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:07 smithi145 bash[35820]: cluster 2024-02-10T08:53:05.492977+0000 mgr.y (mgr.24712) 31 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.521915+0000 mon.c (mon.1) 113 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.522197+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.522348+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.522464+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.522758+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.523030+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.523403+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[35794]: audit 2024-02-10T08:53:07.523683+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.521915+0000 mon.c (mon.1) 113 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.522197+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.522348+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.522464+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.522758+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.523030+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.523403+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:08 smithi040 bash[38951]: audit 2024-02-10T08:53:07.523683+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.521915+0000 mon.c (mon.1) 113 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:53:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.522197+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.522348+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:53:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.522464+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.522758+0000 mon.c (mon.1) 116 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.523030+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.523403+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:53:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:08 smithi145 bash[35820]: audit 2024-02-10T08:53:07.523683+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-10T08:53:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:09 smithi040 bash[35794]: cluster 2024-02-10T08:53:07.493371+0000 mgr.y (mgr.24712) 32 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:09 smithi040 bash[38951]: cluster 2024-02-10T08:53:07.493371+0000 mgr.y (mgr.24712) 32 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:09 smithi145 bash[35820]: cluster 2024-02-10T08:53:07.493371+0000 mgr.y (mgr.24712) 32 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:10 smithi040 bash[35794]: cluster 2024-02-10T08:53:09.494302+0000 mgr.y (mgr.24712) 33 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:10 smithi040 bash[38951]: cluster 2024-02-10T08:53:09.494302+0000 mgr.y (mgr.24712) 33 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:10 smithi145 bash[35820]: cluster 2024-02-10T08:53:09.494302+0000 mgr.y (mgr.24712) 33 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:13 smithi040 bash[35794]: cluster 2024-02-10T08:53:11.494730+0000 mgr.y (mgr.24712) 34 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:13 smithi040 bash[38951]: cluster 2024-02-10T08:53:11.494730+0000 mgr.y (mgr.24712) 34 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:13 smithi145 bash[35820]: cluster 2024-02-10T08:53:11.494730+0000 mgr.y (mgr.24712) 34 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:14 smithi040 bash[35794]: audit 2024-02-10T08:53:14.105047+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:53:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:14 smithi040 bash[35794]: audit 2024-02-10T08:53:14.105357+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:53:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:14 smithi040 bash[35794]: audit 2024-02-10T08:53:14.108144+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:53:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:14 smithi040 bash[38951]: audit 2024-02-10T08:53:14.105047+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:53:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:14 smithi040 bash[38951]: audit 2024-02-10T08:53:14.105357+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:53:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:14 smithi040 bash[38951]: audit 2024-02-10T08:53:14.108144+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:53:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:14 smithi145 bash[35820]: audit 2024-02-10T08:53:14.105047+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:53:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:14 smithi145 bash[35820]: audit 2024-02-10T08:53:14.105357+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:53:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:14 smithi145 bash[35820]: audit 2024-02-10T08:53:14.108144+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:53:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:15 smithi040 bash[35794]: cluster 2024-02-10T08:53:13.495398+0000 mgr.y (mgr.24712) 35 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:15 smithi040 bash[38951]: cluster 2024-02-10T08:53:13.495398+0000 mgr.y (mgr.24712) 35 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:15 smithi145 bash[35820]: cluster 2024-02-10T08:53:13.495398+0000 mgr.y (mgr.24712) 35 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:17 smithi040 bash[35794]: cluster 2024-02-10T08:53:15.495880+0000 mgr.y (mgr.24712) 36 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:17 smithi040 bash[38951]: cluster 2024-02-10T08:53:15.495880+0000 mgr.y (mgr.24712) 36 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:17 smithi145 bash[35820]: cluster 2024-02-10T08:53:15.495880+0000 mgr.y (mgr.24712) 36 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:19 smithi040 bash[35794]: cluster 2024-02-10T08:53:17.496282+0000 mgr.y (mgr.24712) 37 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:19.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:19 smithi040 bash[38951]: cluster 2024-02-10T08:53:17.496282+0000 mgr.y (mgr.24712) 37 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:19 smithi145 bash[35820]: cluster 2024-02-10T08:53:17.496282+0000 mgr.y (mgr.24712) 37 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:21 smithi040 bash[35794]: cluster 2024-02-10T08:53:19.497047+0000 mgr.y (mgr.24712) 38 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:21.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:21 smithi040 bash[38951]: cluster 2024-02-10T08:53:19.497047+0000 mgr.y (mgr.24712) 38 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:21 smithi145 bash[35820]: cluster 2024-02-10T08:53:19.497047+0000 mgr.y (mgr.24712) 38 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:23.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:23 smithi040 bash[35794]: cluster 2024-02-10T08:53:21.497562+0000 mgr.y (mgr.24712) 39 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:23.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:23 smithi040 bash[38951]: cluster 2024-02-10T08:53:21.497562+0000 mgr.y (mgr.24712) 39 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:23 smithi145 bash[35820]: cluster 2024-02-10T08:53:21.497562+0000 mgr.y (mgr.24712) 39 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:25 smithi040 bash[35794]: cluster 2024-02-10T08:53:23.498200+0000 mgr.y (mgr.24712) 40 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:25 smithi040 bash[38951]: cluster 2024-02-10T08:53:23.498200+0000 mgr.y (mgr.24712) 40 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:25 smithi145 bash[35820]: cluster 2024-02-10T08:53:23.498200+0000 mgr.y (mgr.24712) 40 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:27 smithi040 bash[35794]: cluster 2024-02-10T08:53:25.498550+0000 mgr.y (mgr.24712) 41 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:27 smithi040 bash[38951]: cluster 2024-02-10T08:53:25.498550+0000 mgr.y (mgr.24712) 41 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:27 smithi145 bash[35820]: cluster 2024-02-10T08:53:25.498550+0000 mgr.y (mgr.24712) 41 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:29.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:29 smithi040 bash[35794]: cluster 2024-02-10T08:53:27.499220+0000 mgr.y (mgr.24712) 42 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:29 smithi040 bash[38951]: cluster 2024-02-10T08:53:27.499220+0000 mgr.y (mgr.24712) 42 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:29 smithi145 bash[35820]: cluster 2024-02-10T08:53:27.499220+0000 mgr.y (mgr.24712) 42 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:31.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:31 smithi040 bash[35794]: cluster 2024-02-10T08:53:29.499849+0000 mgr.y (mgr.24712) 43 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:31.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:31 smithi040 bash[38951]: cluster 2024-02-10T08:53:29.499849+0000 mgr.y (mgr.24712) 43 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:31 smithi145 bash[35820]: cluster 2024-02-10T08:53:29.499849+0000 mgr.y (mgr.24712) 43 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:33 smithi040 bash[35794]: cluster 2024-02-10T08:53:31.500260+0000 mgr.y (mgr.24712) 44 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:33 smithi040 bash[38951]: cluster 2024-02-10T08:53:31.500260+0000 mgr.y (mgr.24712) 44 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:33 smithi145 bash[35820]: cluster 2024-02-10T08:53:31.500260+0000 mgr.y (mgr.24712) 44 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:34.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:34 smithi040 bash[35794]: cluster 2024-02-10T08:53:33.500986+0000 mgr.y (mgr.24712) 45 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:34.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:34 smithi040 bash[38951]: cluster 2024-02-10T08:53:33.500986+0000 mgr.y (mgr.24712) 45 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:34 smithi145 bash[35820]: cluster 2024-02-10T08:53:33.500986+0000 mgr.y (mgr.24712) 45 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:37 smithi040 bash[35794]: cluster 2024-02-10T08:53:35.501459+0000 mgr.y (mgr.24712) 46 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:37 smithi040 bash[38951]: cluster 2024-02-10T08:53:35.501459+0000 mgr.y (mgr.24712) 46 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:37 smithi145 bash[35820]: cluster 2024-02-10T08:53:35.501459+0000 mgr.y (mgr.24712) 46 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:39 smithi040 bash[35794]: cluster 2024-02-10T08:53:37.501959+0000 mgr.y (mgr.24712) 47 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:39 smithi040 bash[38951]: cluster 2024-02-10T08:53:37.501959+0000 mgr.y (mgr.24712) 47 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:39 smithi145 bash[35820]: cluster 2024-02-10T08:53:37.501959+0000 mgr.y (mgr.24712) 47 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:41 smithi040 bash[35794]: cluster 2024-02-10T08:53:39.502776+0000 mgr.y (mgr.24712) 48 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:41 smithi040 bash[38951]: cluster 2024-02-10T08:53:39.502776+0000 mgr.y (mgr.24712) 48 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:41 smithi145 bash[35820]: cluster 2024-02-10T08:53:39.502776+0000 mgr.y (mgr.24712) 48 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:43 smithi040 bash[35794]: cluster 2024-02-10T08:53:41.503252+0000 mgr.y (mgr.24712) 49 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:43.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:43 smithi040 bash[38951]: cluster 2024-02-10T08:53:41.503252+0000 mgr.y (mgr.24712) 49 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:43 smithi145 bash[35820]: cluster 2024-02-10T08:53:41.503252+0000 mgr.y (mgr.24712) 49 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:45 smithi040 bash[35794]: cluster 2024-02-10T08:53:43.504127+0000 mgr.y (mgr.24712) 50 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:45 smithi040 bash[38951]: cluster 2024-02-10T08:53:43.504127+0000 mgr.y (mgr.24712) 50 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:45 smithi145 bash[35820]: cluster 2024-02-10T08:53:43.504127+0000 mgr.y (mgr.24712) 50 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:47 smithi040 bash[35794]: cluster 2024-02-10T08:53:45.504472+0000 mgr.y (mgr.24712) 51 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:47 smithi040 bash[38951]: cluster 2024-02-10T08:53:45.504472+0000 mgr.y (mgr.24712) 51 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:47 smithi145 bash[35820]: cluster 2024-02-10T08:53:45.504472+0000 mgr.y (mgr.24712) 51 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:49 smithi040 bash[35794]: cluster 2024-02-10T08:53:47.505027+0000 mgr.y (mgr.24712) 52 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:49 smithi040 bash[38951]: cluster 2024-02-10T08:53:47.505027+0000 mgr.y (mgr.24712) 52 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:49 smithi145 bash[35820]: cluster 2024-02-10T08:53:47.505027+0000 mgr.y (mgr.24712) 52 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:51 smithi040 bash[35794]: cluster 2024-02-10T08:53:49.505836+0000 mgr.y (mgr.24712) 53 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:51 smithi040 bash[38951]: cluster 2024-02-10T08:53:49.505836+0000 mgr.y (mgr.24712) 53 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:51 smithi145 bash[35820]: cluster 2024-02-10T08:53:49.505836+0000 mgr.y (mgr.24712) 53 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:53 smithi040 bash[35794]: cluster 2024-02-10T08:53:51.506429+0000 mgr.y (mgr.24712) 54 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:53 smithi040 bash[38951]: cluster 2024-02-10T08:53:51.506429+0000 mgr.y (mgr.24712) 54 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:53 smithi145 bash[35820]: cluster 2024-02-10T08:53:51.506429+0000 mgr.y (mgr.24712) 54 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:55 smithi040 bash[35794]: cluster 2024-02-10T08:53:53.507260+0000 mgr.y (mgr.24712) 55 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:55 smithi040 bash[38951]: cluster 2024-02-10T08:53:53.507260+0000 mgr.y (mgr.24712) 55 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:55 smithi145 bash[35820]: cluster 2024-02-10T08:53:53.507260+0000 mgr.y (mgr.24712) 55 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:57 smithi040 bash[35794]: cluster 2024-02-10T08:53:55.507824+0000 mgr.y (mgr.24712) 56 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:57 smithi040 bash[38951]: cluster 2024-02-10T08:53:55.507824+0000 mgr.y (mgr.24712) 56 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:57 smithi145 bash[35820]: cluster 2024-02-10T08:53:55.507824+0000 mgr.y (mgr.24712) 56 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:53:59 smithi040 bash[35794]: cluster 2024-02-10T08:53:57.508416+0000 mgr.y (mgr.24712) 57 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:53:59 smithi040 bash[38951]: cluster 2024-02-10T08:53:57.508416+0000 mgr.y (mgr.24712) 57 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:53:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:53:59 smithi145 bash[35820]: cluster 2024-02-10T08:53:57.508416+0000 mgr.y (mgr.24712) 57 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:01 smithi040 bash[35794]: cluster 2024-02-10T08:53:59.509132+0000 mgr.y (mgr.24712) 58 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:01 smithi040 bash[38951]: cluster 2024-02-10T08:53:59.509132+0000 mgr.y (mgr.24712) 58 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:01 smithi145 bash[35820]: cluster 2024-02-10T08:53:59.509132+0000 mgr.y (mgr.24712) 58 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:02 smithi040 bash[35794]: cluster 2024-02-10T08:54:01.509545+0000 mgr.y (mgr.24712) 59 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:02 smithi040 bash[38951]: cluster 2024-02-10T08:54:01.509545+0000 mgr.y (mgr.24712) 59 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:02 smithi145 bash[35820]: cluster 2024-02-10T08:54:01.509545+0000 mgr.y (mgr.24712) 59 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:04.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:04 smithi040 bash[35794]: cluster 2024-02-10T08:54:03.510197+0000 mgr.y (mgr.24712) 60 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:04.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:04 smithi040 bash[38951]: cluster 2024-02-10T08:54:03.510197+0000 mgr.y (mgr.24712) 60 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:04 smithi145 bash[35820]: cluster 2024-02-10T08:54:03.510197+0000 mgr.y (mgr.24712) 60 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:07 smithi040 bash[35794]: cluster 2024-02-10T08:54:05.510630+0000 mgr.y (mgr.24712) 61 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:07.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:07 smithi040 bash[38951]: cluster 2024-02-10T08:54:05.510630+0000 mgr.y (mgr.24712) 61 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:07 smithi145 bash[35820]: cluster 2024-02-10T08:54:05.510630+0000 mgr.y (mgr.24712) 61 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.526089+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.526342+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.526524+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.526554+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.526711+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.527239+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.527532+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[35794]: audit 2024-02-10T08:54:07.527829+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.526089+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:54:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.526342+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.526524+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:54:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.526554+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:54:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.526711+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.527239+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.527532+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:54:08.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:08 smithi040 bash[38951]: audit 2024-02-10T08:54:07.527829+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.526089+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:54:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.526342+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.526524+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:54:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.526554+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-02-10T08:54:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.526711+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.527239+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:54:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.527532+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:54:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:08 smithi145 bash[35820]: audit 2024-02-10T08:54:07.527829+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:54:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:09 smithi040 bash[35794]: cluster 2024-02-10T08:54:07.511124+0000 mgr.y (mgr.24712) 62 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:09 smithi040 bash[38951]: cluster 2024-02-10T08:54:07.511124+0000 mgr.y (mgr.24712) 62 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:09 smithi145 bash[35820]: cluster 2024-02-10T08:54:07.511124+0000 mgr.y (mgr.24712) 62 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:11 smithi040 bash[35794]: cluster 2024-02-10T08:54:09.511850+0000 mgr.y (mgr.24712) 63 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:11 smithi040 bash[38951]: cluster 2024-02-10T08:54:09.511850+0000 mgr.y (mgr.24712) 63 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:11 smithi145 bash[35820]: cluster 2024-02-10T08:54:09.511850+0000 mgr.y (mgr.24712) 63 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:13 smithi040 bash[35794]: cluster 2024-02-10T08:54:11.512270+0000 mgr.y (mgr.24712) 64 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:13.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:13 smithi040 bash[38951]: cluster 2024-02-10T08:54:11.512270+0000 mgr.y (mgr.24712) 64 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:13 smithi145 bash[35820]: cluster 2024-02-10T08:54:11.512270+0000 mgr.y (mgr.24712) 64 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[35794]: cluster 2024-02-10T08:54:13.512942+0000 mgr.y (mgr.24712) 65 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[35794]: audit 2024-02-10T08:54:14.419113+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[35794]: audit 2024-02-10T08:54:14.419423+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[35794]: audit 2024-02-10T08:54:14.422416+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[38951]: cluster 2024-02-10T08:54:13.512942+0000 mgr.y (mgr.24712) 65 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[38951]: audit 2024-02-10T08:54:14.419113+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[38951]: audit 2024-02-10T08:54:14.419423+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:54:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:15 smithi040 bash[38951]: audit 2024-02-10T08:54:14.422416+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:54:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:15 smithi145 bash[35820]: cluster 2024-02-10T08:54:13.512942+0000 mgr.y (mgr.24712) 65 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:15 smithi145 bash[35820]: audit 2024-02-10T08:54:14.419113+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:54:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:15 smithi145 bash[35820]: audit 2024-02-10T08:54:14.419423+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:54:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:15 smithi145 bash[35820]: audit 2024-02-10T08:54:14.422416+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:54:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:17 smithi040 bash[35794]: cluster 2024-02-10T08:54:15.513489+0000 mgr.y (mgr.24712) 66 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:17 smithi040 bash[38951]: cluster 2024-02-10T08:54:15.513489+0000 mgr.y (mgr.24712) 66 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:17 smithi145 bash[35820]: cluster 2024-02-10T08:54:15.513489+0000 mgr.y (mgr.24712) 66 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:19 smithi040 bash[35794]: cluster 2024-02-10T08:54:17.514023+0000 mgr.y (mgr.24712) 67 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:19 smithi040 bash[38951]: cluster 2024-02-10T08:54:17.514023+0000 mgr.y (mgr.24712) 67 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:19 smithi145 bash[35820]: cluster 2024-02-10T08:54:17.514023+0000 mgr.y (mgr.24712) 67 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:21.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:21 smithi040 bash[35794]: cluster 2024-02-10T08:54:19.514646+0000 mgr.y (mgr.24712) 68 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:21.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:21 smithi040 bash[38951]: cluster 2024-02-10T08:54:19.514646+0000 mgr.y (mgr.24712) 68 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:21 smithi145 bash[35820]: cluster 2024-02-10T08:54:19.514646+0000 mgr.y (mgr.24712) 68 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:23.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:23 smithi040 bash[35794]: cluster 2024-02-10T08:54:21.515020+0000 mgr.y (mgr.24712) 69 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:23.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:23 smithi040 bash[38951]: cluster 2024-02-10T08:54:21.515020+0000 mgr.y (mgr.24712) 69 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:23 smithi145 bash[35820]: cluster 2024-02-10T08:54:21.515020+0000 mgr.y (mgr.24712) 69 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:25 smithi040 bash[35794]: cluster 2024-02-10T08:54:23.515727+0000 mgr.y (mgr.24712) 70 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:25.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:25 smithi040 bash[38951]: cluster 2024-02-10T08:54:23.515727+0000 mgr.y (mgr.24712) 70 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:25 smithi145 bash[35820]: cluster 2024-02-10T08:54:23.515727+0000 mgr.y (mgr.24712) 70 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:27.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:27 smithi040 bash[35794]: cluster 2024-02-10T08:54:25.516253+0000 mgr.y (mgr.24712) 71 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:27.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:27 smithi040 bash[38951]: cluster 2024-02-10T08:54:25.516253+0000 mgr.y (mgr.24712) 71 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:27 smithi145 bash[35820]: cluster 2024-02-10T08:54:25.516253+0000 mgr.y (mgr.24712) 71 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:28 smithi145 bash[35820]: cluster 2024-02-10T08:54:27.516562+0000 mgr.y (mgr.24712) 72 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:28.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:28 smithi040 bash[35794]: cluster 2024-02-10T08:54:27.516562+0000 mgr.y (mgr.24712) 72 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:28.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:28 smithi040 bash[38951]: cluster 2024-02-10T08:54:27.516562+0000 mgr.y (mgr.24712) 72 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:30.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:30 smithi040 bash[35794]: cluster 2024-02-10T08:54:29.517383+0000 mgr.y (mgr.24712) 73 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:30.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:30 smithi040 bash[38951]: cluster 2024-02-10T08:54:29.517383+0000 mgr.y (mgr.24712) 73 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:31.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:30 smithi145 bash[35820]: cluster 2024-02-10T08:54:29.517383+0000 mgr.y (mgr.24712) 73 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:33.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:33 smithi040 bash[35794]: cluster 2024-02-10T08:54:31.517805+0000 mgr.y (mgr.24712) 74 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:33.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:33 smithi040 bash[38951]: cluster 2024-02-10T08:54:31.517805+0000 mgr.y (mgr.24712) 74 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:33 smithi145 bash[35820]: cluster 2024-02-10T08:54:31.517805+0000 mgr.y (mgr.24712) 74 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:35.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:35 smithi040 bash[35794]: cluster 2024-02-10T08:54:33.518465+0000 mgr.y (mgr.24712) 75 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:35.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:35 smithi040 bash[38951]: cluster 2024-02-10T08:54:33.518465+0000 mgr.y (mgr.24712) 75 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:35.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:35 smithi145 bash[35820]: cluster 2024-02-10T08:54:33.518465+0000 mgr.y (mgr.24712) 75 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:37 smithi040 bash[35794]: cluster 2024-02-10T08:54:35.518984+0000 mgr.y (mgr.24712) 76 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:37 smithi040 bash[38951]: cluster 2024-02-10T08:54:35.518984+0000 mgr.y (mgr.24712) 76 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:37 smithi145 bash[35820]: cluster 2024-02-10T08:54:35.518984+0000 mgr.y (mgr.24712) 76 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:39.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:39 smithi040 bash[35794]: cluster 2024-02-10T08:54:37.519456+0000 mgr.y (mgr.24712) 77 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:39.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:39 smithi040 bash[38951]: cluster 2024-02-10T08:54:37.519456+0000 mgr.y (mgr.24712) 77 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:39 smithi145 bash[35820]: cluster 2024-02-10T08:54:37.519456+0000 mgr.y (mgr.24712) 77 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:41 smithi040 bash[35794]: cluster 2024-02-10T08:54:39.520367+0000 mgr.y (mgr.24712) 78 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:41.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:41 smithi040 bash[38951]: cluster 2024-02-10T08:54:39.520367+0000 mgr.y (mgr.24712) 78 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:41 smithi145 bash[35820]: cluster 2024-02-10T08:54:39.520367+0000 mgr.y (mgr.24712) 78 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:43.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:43 smithi040 bash[35794]: cluster 2024-02-10T08:54:41.520841+0000 mgr.y (mgr.24712) 79 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:43.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:43 smithi040 bash[38951]: cluster 2024-02-10T08:54:41.520841+0000 mgr.y (mgr.24712) 79 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:43 smithi145 bash[35820]: cluster 2024-02-10T08:54:41.520841+0000 mgr.y (mgr.24712) 79 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:45 smithi040 bash[35794]: cluster 2024-02-10T08:54:43.521767+0000 mgr.y (mgr.24712) 80 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:45 smithi040 bash[38951]: cluster 2024-02-10T08:54:43.521767+0000 mgr.y (mgr.24712) 80 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:45 smithi145 bash[35820]: cluster 2024-02-10T08:54:43.521767+0000 mgr.y (mgr.24712) 80 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:47.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:47 smithi040 bash[35794]: cluster 2024-02-10T08:54:45.522229+0000 mgr.y (mgr.24712) 81 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:47.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:47 smithi040 bash[38951]: cluster 2024-02-10T08:54:45.522229+0000 mgr.y (mgr.24712) 81 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:47 smithi145 bash[35820]: cluster 2024-02-10T08:54:45.522229+0000 mgr.y (mgr.24712) 81 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:49.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:49 smithi040 bash[35794]: cluster 2024-02-10T08:54:47.522622+0000 mgr.y (mgr.24712) 82 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:49.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:49 smithi040 bash[38951]: cluster 2024-02-10T08:54:47.522622+0000 mgr.y (mgr.24712) 82 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:49 smithi145 bash[35820]: cluster 2024-02-10T08:54:47.522622+0000 mgr.y (mgr.24712) 82 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:51.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:51 smithi040 bash[35794]: cluster 2024-02-10T08:54:49.523295+0000 mgr.y (mgr.24712) 83 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:51 smithi040 bash[38951]: cluster 2024-02-10T08:54:49.523295+0000 mgr.y (mgr.24712) 83 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:51 smithi145 bash[35820]: cluster 2024-02-10T08:54:49.523295+0000 mgr.y (mgr.24712) 83 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:53 smithi040 bash[35794]: cluster 2024-02-10T08:54:51.523666+0000 mgr.y (mgr.24712) 84 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:53 smithi040 bash[38951]: cluster 2024-02-10T08:54:51.523666+0000 mgr.y (mgr.24712) 84 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:53 smithi145 bash[35820]: cluster 2024-02-10T08:54:51.523666+0000 mgr.y (mgr.24712) 84 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:55 smithi040 bash[35794]: cluster 2024-02-10T08:54:53.524379+0000 mgr.y (mgr.24712) 85 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:55.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:55 smithi040 bash[38951]: cluster 2024-02-10T08:54:53.524379+0000 mgr.y (mgr.24712) 85 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:55 smithi145 bash[35820]: cluster 2024-02-10T08:54:53.524379+0000 mgr.y (mgr.24712) 85 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:57 smithi040 bash[35794]: cluster 2024-02-10T08:54:55.524892+0000 mgr.y (mgr.24712) 86 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:57 smithi040 bash[38951]: cluster 2024-02-10T08:54:55.524892+0000 mgr.y (mgr.24712) 86 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:57 smithi145 bash[35820]: cluster 2024-02-10T08:54:55.524892+0000 mgr.y (mgr.24712) 86 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:59.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:54:59 smithi040 bash[35794]: cluster 2024-02-10T08:54:57.525351+0000 mgr.y (mgr.24712) 87 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:54:59 smithi040 bash[38951]: cluster 2024-02-10T08:54:57.525351+0000 mgr.y (mgr.24712) 87 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:54:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:54:59 smithi145 bash[35820]: cluster 2024-02-10T08:54:57.525351+0000 mgr.y (mgr.24712) 87 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:01.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:01 smithi040 bash[35794]: cluster 2024-02-10T08:54:59.526240+0000 mgr.y (mgr.24712) 88 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:01.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:01 smithi040 bash[38951]: cluster 2024-02-10T08:54:59.526240+0000 mgr.y (mgr.24712) 88 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:01 smithi145 bash[35820]: cluster 2024-02-10T08:54:59.526240+0000 mgr.y (mgr.24712) 88 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:03.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:03 smithi040 bash[35794]: cluster 2024-02-10T08:55:01.526626+0000 mgr.y (mgr.24712) 89 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:03.670 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:03 smithi040 bash[38951]: cluster 2024-02-10T08:55:01.526626+0000 mgr.y (mgr.24712) 89 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:03 smithi145 bash[35820]: cluster 2024-02-10T08:55:01.526626+0000 mgr.y (mgr.24712) 89 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:04.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:04 smithi040 bash[35794]: cluster 2024-02-10T08:55:03.527454+0000 mgr.y (mgr.24712) 90 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:04.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T08:55:04.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:04 smithi040 bash[38951]: cluster 2024-02-10T08:55:03.527454+0000 mgr.y (mgr.24712) 90 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:04 smithi145 bash[35820]: cluster 2024-02-10T08:55:03.527454+0000 mgr.y (mgr.24712) 90 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:06.513 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:55:06.513 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (9m) 2m ago 18m 17.2M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:55:06.513 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (18m) 2m ago 18m 35.0M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:55:06.513 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (13m) 2m ago 22m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc b9b23ff414a1 2024-02-10T08:55:06.513 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (5m) 2m ago 24m 409M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (24m) 2m ago 24m 145M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (22m) 2m ago 22m 126M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (22m) 2m ago 22m 122M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (18m) 2m ago 19m 13.6M - 1.7.0 72c9c2088986 499f0f53e04a 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (18m) 2m ago 19m 13.6M - 1.7.0 72c9c2088986 b3a2408fef6b 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (21m) 2m ago 21m 47.3M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (21m) 2m ago 21m 44.7M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (21m) 2m ago 21m 45.0M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (20m) 2m ago 20m 48.3M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (20m) 2m ago 20m 46.5M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (20m) 2m ago 20m 44.9M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (19m) 2m ago 19m 44.3M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (19m) 2m ago 19m 45.7M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (8m) 2m ago 19m 50.6M - 2.49.1 2a72b385beaf 37cd9848751b 2024-02-10T08:55:06.514 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (17m) 2m ago 17m 35.6M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:55:06.515 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (17m) 2m ago 17m 36.2M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:55:07.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T08:55:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: cluster 2024-02-10T08:55:05.527850+0000 mgr.y (mgr.24712) 91 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.502989+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.503364+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.503701+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.504073+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.504428+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.504750+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.506429+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.506736+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.507078+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.507405+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[35794]: audit 2024-02-10T08:55:06.507729+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: cluster 2024-02-10T08:55:05.527850+0000 mgr.y (mgr.24712) 91 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.502989+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.503364+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.503701+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.504073+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.504428+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.504750+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.506429+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.506736+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.507078+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.507405+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:07 smithi040 bash[38951]: audit 2024-02-10T08:55:06.507729+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: cluster 2024-02-10T08:55:05.527850+0000 mgr.y (mgr.24712) 91 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.502989+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.503364+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.503701+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.504073+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.504428+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.504750+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.506429+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.506736+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.507078+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.507405+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:07 smithi145 bash[35820]: audit 2024-02-10T08:55:06.507729+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:06.500903+0000 mgr.y (mgr.24712) 92 : audit [DBG] from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.529978+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.530248+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.530317+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.530469+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.530692+0000 mon.c (mon.1) 137 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.530743+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.531171+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.628 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[38951]: audit 2024-02-10T08:55:07.531425+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:06.500903+0000 mgr.y (mgr.24712) 92 : audit [DBG] from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.529978+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.530248+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.530317+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.530469+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.530692+0000 mon.c (mon.1) 137 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.530743+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.531171+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.629 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:08 smithi040 bash[35794]: audit 2024-02-10T08:55:07.531425+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:06.500903+0000 mgr.y (mgr.24712) 92 : audit [DBG] from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.529978+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.530248+0000 mon.c (mon.1) 135 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.530317+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.530469+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.530692+0000 mon.c (mon.1) 137 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.530743+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-02-10T08:55:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.531171+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:55:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:08 smithi145 bash[35820]: audit 2024-02-10T08:55:07.531425+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T08:55:09.144 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:55:09.144 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:55:09.144 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:55:09.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:55:09.144 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:55:09.145 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:55:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:09 smithi040 bash[35794]: cluster 2024-02-10T08:55:07.528142+0000 mgr.y (mgr.24712) 93 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:09 smithi040 bash[35794]: audit 2024-02-10T08:55:09.143704+0000 mon.a (mon.0) 746 : audit [DBG] from='client.? 172.21.15.40:0/266613239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:55:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:09 smithi040 bash[38951]: cluster 2024-02-10T08:55:07.528142+0000 mgr.y (mgr.24712) 93 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:09 smithi040 bash[38951]: audit 2024-02-10T08:55:09.143704+0000 mon.a (mon.0) 746 : audit [DBG] from='client.? 172.21.15.40:0/266613239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:55:09.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph -s' 2024-02-10T08:55:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:09 smithi145 bash[35820]: cluster 2024-02-10T08:55:07.528142+0000 mgr.y (mgr.24712) 93 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:09 smithi145 bash[35820]: audit 2024-02-10T08:55:09.143704+0000 mon.a (mon.0) 746 : audit [DBG] from='client.? 172.21.15.40:0/266613239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:55:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:11 smithi040 bash[35794]: cluster 2024-02-10T08:55:09.528775+0000 mgr.y (mgr.24712) 94 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:11.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:11 smithi040 bash[38951]: cluster 2024-02-10T08:55:09.528775+0000 mgr.y (mgr.24712) 94 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:11 smithi145 bash[35820]: cluster 2024-02-10T08:55:09.528775+0000 mgr.y (mgr.24712) 94 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: cluster: 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: id: a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: health: HEALTH_OK 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: services: 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: mon: 3 daemons, quorum a,c,b (age 22m) 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: mgr: y(active, since 3m), standbys: x 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: osd: 8 osds: 8 up (since 19m), 8 in (since 19m) 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: rgw: 2 daemons active (r.z.smithi040.skjeib, r.z.smithi145.uizklq) 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:55:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: task status: 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: data: 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: pools: 5 pools, 129 pgs 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: objects: 202 objects, 7.0 KiB 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: usage: 8.0 GiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: pgs: 129 active+clean 2024-02-10T08:55:11.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-02-10T08:55:12.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-10T08:55:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:12 smithi040 bash[35794]: audit 2024-02-10T08:55:11.795844+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.15.40:0/4212274296' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:55:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:12 smithi040 bash[38951]: audit 2024-02-10T08:55:11.795844+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.15.40:0/4212274296' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:55:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:12 smithi145 bash[35820]: audit 2024-02-10T08:55:11.795844+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.15.40:0/4212274296' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-10T08:55:13.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:13 smithi040 bash[35794]: cluster 2024-02-10T08:55:11.529102+0000 mgr.y (mgr.24712) 95 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:13.657 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:13 smithi040 bash[38951]: cluster 2024-02-10T08:55:11.529102+0000 mgr.y (mgr.24712) 95 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:13 smithi145 bash[35820]: cluster 2024-02-10T08:55:11.529102+0000 mgr.y (mgr.24712) 95 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:14.389 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T08:55:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:14 smithi040 bash[35794]: audit 2024-02-10T08:55:14.378164+0000 mon.a (mon.0) 748 : audit [DBG] from='client.? 172.21.15.40:0/3078810778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:55:14.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:14 smithi040 bash[38951]: audit 2024-02-10T08:55:14.378164+0000 mon.a (mon.0) 748 : audit [DBG] from='client.? 172.21.15.40:0/3078810778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:55:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:14 smithi145 bash[35820]: audit 2024-02-10T08:55:14.378164+0000 mon.a (mon.0) 748 : audit [DBG] from='client.? 172.21.15.40:0/3078810778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:55:15.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph mgr fail' 2024-02-10T08:55:15.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[35794]: cluster 2024-02-10T08:55:13.529970+0000 mgr.y (mgr.24712) 96 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[35794]: audit 2024-02-10T08:55:14.723829+0000 mon.c (mon.1) 138 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[35794]: audit 2024-02-10T08:55:14.724160+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[35794]: audit 2024-02-10T08:55:14.727189+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[38951]: cluster 2024-02-10T08:55:13.529970+0000 mgr.y (mgr.24712) 96 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[38951]: audit 2024-02-10T08:55:14.723829+0000 mon.c (mon.1) 138 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[38951]: audit 2024-02-10T08:55:14.724160+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:15.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:15 smithi040 bash[38951]: audit 2024-02-10T08:55:14.727189+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:15 smithi145 bash[35820]: cluster 2024-02-10T08:55:13.529970+0000 mgr.y (mgr.24712) 96 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:15 smithi145 bash[35820]: audit 2024-02-10T08:55:14.723829+0000 mon.c (mon.1) 138 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:15 smithi145 bash[35820]: audit 2024-02-10T08:55:14.724160+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:15 smithi145 bash[35820]: audit 2024-02-10T08:55:14.727189+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: cluster 2024-02-10T08:55:15.530378+0000 mgr.y (mgr.24712) 97 : cluster [DBG] pgmap v97: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: audit 2024-02-10T08:55:17.000529+0000 mon.a (mon.0) 751 : audit [INF] from='client.? 172.21.15.40:0/3741761080' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: cluster 2024-02-10T08:55:17.006397+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: audit 2024-02-10T08:55:17.006496+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: audit 2024-02-10T08:55:17.007112+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: audit 2024-02-10T08:55:17.007848+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:55:17.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: audit 2024-02-10T08:55:17.008107+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[38951]: cluster 2024-02-10T08:55:17.110500+0000 mon.a (mon.0) 755 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: cluster 2024-02-10T08:55:15.530378+0000 mgr.y (mgr.24712) 97 : cluster [DBG] pgmap v97: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: audit 2024-02-10T08:55:17.000529+0000 mon.a (mon.0) 751 : audit [INF] from='client.? 172.21.15.40:0/3741761080' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: cluster 2024-02-10T08:55:17.006397+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: audit 2024-02-10T08:55:17.006496+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: audit 2024-02-10T08:55:17.007112+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: audit 2024-02-10T08:55:17.007848+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: audit 2024-02-10T08:55:17.008107+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:55:17.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:17 smithi040 bash[35794]: cluster 2024-02-10T08:55:17.110500+0000 mon.a (mon.0) 755 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:55:17.671 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:17.405+0000 7f61c2c24700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-10T08:55:17.671 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: ignoring --setuser ceph since I am not root 2024-02-10T08:55:17.671 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: ignoring --setgroup ceph since I am not root 2024-02-10T08:55:17.671 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:17.448+0000 7fa6e3d2c700 1 -- 172.21.15.40:0/1319979852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563235fb44e0 con 0x563235f8ac00 2024-02-10T08:55:17.671 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:17.581+0000 7fa6f3f0a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:55:17.671 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:17.668+0000 7fa6f3f0a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:55:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: cluster 2024-02-10T08:55:15.530378+0000 mgr.y (mgr.24712) 97 : cluster [DBG] pgmap v97: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: audit 2024-02-10T08:55:17.000529+0000 mon.a (mon.0) 751 : audit [INF] from='client.? 172.21.15.40:0/3741761080' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-02-10T08:55:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: cluster 2024-02-10T08:55:17.006397+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-10T08:55:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: audit 2024-02-10T08:55:17.006496+0000 mon.c (mon.1) 139 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:55:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: audit 2024-02-10T08:55:17.007112+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:55:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: audit 2024-02-10T08:55:17.007848+0000 mon.c (mon.1) 140 : audit [INF] from='mgr.24712 172.21.15.40:0/516021032' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:55:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: audit 2024-02-10T08:55:17.008107+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:55:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:17 smithi145 bash[35820]: cluster 2024-02-10T08:55:17.110500+0000 mon.a (mon.0) 755 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:55:18.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 180' 2024-02-10T08:55:18.404 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:18.053+0000 7fa6f3f0a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:55:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[35794]: audit 2024-02-10T08:55:17.406668+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.40:0/3741761080' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:55:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[35794]: cluster 2024-02-10T08:55:17.406764+0000 mon.a (mon.0) 757 : cluster [DBG] mgrmap e24: x(active, starting, since 0.405791s), standbys: y 2024-02-10T08:55:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[35794]: audit 2024-02-10T08:55:18.007097+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:55:18.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[35794]: cluster 2024-02-10T08:55:18.007146+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-10T08:55:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[38951]: audit 2024-02-10T08:55:17.406668+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.40:0/3741761080' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:55:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[38951]: cluster 2024-02-10T08:55:17.406764+0000 mon.a (mon.0) 757 : cluster [DBG] mgrmap e24: x(active, starting, since 0.405791s), standbys: y 2024-02-10T08:55:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[38951]: audit 2024-02-10T08:55:18.007097+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:55:18.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:18 smithi040 bash[38951]: cluster 2024-02-10T08:55:18.007146+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-10T08:55:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:18 smithi145 bash[35820]: audit 2024-02-10T08:55:17.406668+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.40:0/3741761080' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-02-10T08:55:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:18 smithi145 bash[35820]: cluster 2024-02-10T08:55:17.406764+0000 mon.a (mon.0) 757 : cluster [DBG] mgrmap e24: x(active, starting, since 0.405791s), standbys: y 2024-02-10T08:55:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:18 smithi145 bash[35820]: audit 2024-02-10T08:55:18.007097+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24712 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:55:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:18 smithi145 bash[35820]: cluster 2024-02-10T08:55:18.007146+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-10T08:55:19.126 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:18.872+0000 7fa6f3f0a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:55:19.126 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:18.955+0000 7fa6f3f0a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:55:19.382 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:19.177+0000 7fa6f3f0a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:55:20.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:20.170+0000 7fa6f3f0a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:55:20.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:20.305+0000 7fa6f3f0a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:55:20.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:20.388+0000 7fa6f3f0a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:55:20.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:20.482+0000 7fa6f3f0a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:55:20.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:20.686+0000 7fa6f3f0a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:55:21.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:20.981+0000 7fa6f3f0a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:55:21.425 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:21.083+0000 7fa6f3f0a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:55:22.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:21.842+0000 7fa6f3f0a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:55:22.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:21.928+0000 7fa6f3f0a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:55:22.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:22.026+0000 7fa6f3f0a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:55:22.482 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:22.210+0000 7fa6f3f0a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:55:22.760 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:22.481+0000 7fa6f3f0a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:55:22.760 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:22.618+0000 7fa6f3f0a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:55:22.760 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:22.759+0000 7fa6f3f0a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:55:23.031 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:22.941+0000 7fa6f3f0a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:55:23.031 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:55:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T08:55:23.030+0000 7fa6f3f0a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:55:23.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[35794]: cluster 2024-02-10T08:55:23.043891+0000 mon.a (mon.0) 760 : cluster [DBG] Standby manager daemon y restarted 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[35794]: cluster 2024-02-10T08:55:23.044026+0000 mon.a (mon.0) 761 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[35794]: audit 2024-02-10T08:55:23.045015+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[35794]: audit 2024-02-10T08:55:23.045345+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[35794]: audit 2024-02-10T08:55:23.046259+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[35794]: audit 2024-02-10T08:55:23.046514+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[38951]: cluster 2024-02-10T08:55:23.043891+0000 mon.a (mon.0) 760 : cluster [DBG] Standby manager daemon y restarted 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[38951]: cluster 2024-02-10T08:55:23.044026+0000 mon.a (mon.0) 761 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[38951]: audit 2024-02-10T08:55:23.045015+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[38951]: audit 2024-02-10T08:55:23.045345+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[38951]: audit 2024-02-10T08:55:23.046259+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-10T08:55:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:23 smithi040 bash[38951]: audit 2024-02-10T08:55:23.046514+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:55:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[35820]: cluster 2024-02-10T08:55:23.043891+0000 mon.a (mon.0) 760 : cluster [DBG] Standby manager daemon y restarted 2024-02-10T08:55:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[35820]: cluster 2024-02-10T08:55:23.044026+0000 mon.a (mon.0) 761 : cluster [DBG] Standby manager daemon y started 2024-02-10T08:55:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[35820]: audit 2024-02-10T08:55:23.045015+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-10T08:55:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[35820]: audit 2024-02-10T08:55:23.045345+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:55:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[35820]: audit 2024-02-10T08:55:23.046259+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-10T08:55:23.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[35820]: audit 2024-02-10T08:55:23.046514+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:55:24.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[48458]: Warning: Permanently added '172.21.15.40' (ECDSA) to the list of known hosts. 2024-02-10T08:55:24.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:55:23 smithi145 bash[48458]: Warning: Permanently added '172.21.15.145' (ECDSA) to the list of known hosts. 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: cluster 2024-02-10T08:55:23.100531+0000 mon.a (mon.0) 766 : cluster [DBG] mgrmap e25: x(active, starting, since 6s), standbys: y 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.103790+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.103891+0000 mon.b (mon.2) 193 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.412123+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.412285+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.412501+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.414298+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.414622+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.414923+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.415254+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.415559+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:55:24.110 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.415795+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.416042+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.416283+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.417415+0000 mon.b (mon.2) 205 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.417681+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.418098+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.418963+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.419934+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.420259+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.420571+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.420862+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.421207+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.421538+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.421828+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:55:24.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.422108+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:55:24.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.422400+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:55:24.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.422698+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: cluster 2024-02-10T08:55:23.100531+0000 mon.a (mon.0) 766 : cluster [DBG] mgrmap e25: x(active, starting, since 6s), standbys: y 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.103790+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.103891+0000 mon.b (mon.2) 193 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.412123+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.412285+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.412501+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.414298+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.414622+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.414923+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.415254+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:55:24.113 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.415559+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.415795+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.416042+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.416283+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.417415+0000 mon.b (mon.2) 205 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.417681+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.418098+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.418963+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.419934+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.420259+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.420571+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.420862+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.421207+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.421538+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.421828+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:55:24.114 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.422108+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.422400+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.422698+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.422983+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.423275+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.423583+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.423883+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.424173+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.424461+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.424732+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.425006+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:55:24.115 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.425278+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.425578+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.425850+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.426119+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: cluster 2024-02-10T08:55:23.453439+0000 mon.a (mon.0) 767 : cluster [INF] Manager daemon x is now available 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.556598+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.599466+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.599831+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.608630+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.609427+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.765515+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:55:24.116 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[38951]: audit 2024-02-10T08:55:23.767243+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:55:24.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.422983+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.423275+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.423583+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.423883+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.424173+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.424461+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.424732+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.425006+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.425278+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.425578+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.425850+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.426119+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: cluster 2024-02-10T08:55:23.453439+0000 mon.a (mon.0) 767 : cluster [INF] Manager daemon x is now available 2024-02-10T08:55:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.556598+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:55:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.599466+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:55:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.599831+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:55:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.608630+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:55:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.609427+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:55:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.765515+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:55:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:24 smithi040 bash[35794]: audit 2024-02-10T08:55:23.767243+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: cluster 2024-02-10T08:55:23.100531+0000 mon.a (mon.0) 766 : cluster [DBG] mgrmap e25: x(active, starting, since 6s), standbys: y 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.103790+0000 mon.b (mon.2) 192 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.103891+0000 mon.b (mon.2) 193 : audit [DBG] from='mgr.? 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.412123+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.412285+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.412501+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:55:24.469 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.414298+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.414622+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.414923+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.415254+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.415559+0000 mon.b (mon.2) 201 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.415795+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.416042+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.416283+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.417415+0000 mon.b (mon.2) 205 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.417681+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.418098+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.418963+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.419934+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.420259+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.420571+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:55:24.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.420862+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.421207+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.421538+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.421828+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.422108+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.422400+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.422698+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.422983+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.423275+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.423583+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.423883+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.424173+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.424461+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.424732+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:55:24.471 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.425006+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.425278+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.425578+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.425850+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.426119+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: cluster 2024-02-10T08:55:23.453439+0000 mon.a (mon.0) 767 : cluster [INF] Manager daemon x is now available 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.556598+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.599466+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.599831+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.608630+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.609427+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.765515+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:55:24.472 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:24 smithi145 bash[35820]: audit 2024-02-10T08:55:23.767243+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:55:25.421 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:25 smithi145 bash[35820]: cluster 2024-02-10T08:55:24.118976+0000 mon.a (mon.0) 770 : cluster [DBG] mgrmap e26: x(active, since 7s), standbys: y 2024-02-10T08:55:25.421 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:25 smithi145 bash[35820]: cluster 2024-02-10T08:55:24.124582+0000 mgr.x (mgr.34733) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:25.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:25 smithi040 bash[35794]: cluster 2024-02-10T08:55:24.118976+0000 mon.a (mon.0) 770 : cluster [DBG] mgrmap e26: x(active, since 7s), standbys: y 2024-02-10T08:55:25.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:25 smithi040 bash[35794]: cluster 2024-02-10T08:55:24.124582+0000 mgr.x (mgr.34733) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:25 smithi040 bash[38951]: cluster 2024-02-10T08:55:24.118976+0000 mon.a (mon.0) 770 : cluster [DBG] mgrmap e26: x(active, since 7s), standbys: y 2024-02-10T08:55:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:25 smithi040 bash[38951]: cluster 2024-02-10T08:55:24.124582+0000 mgr.x (mgr.34733) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:26.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:26 smithi040 bash[35794]: cluster 2024-02-10T08:55:25.417497+0000 mgr.x (mgr.34733) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:26 smithi040 bash[38951]: cluster 2024-02-10T08:55:25.417497+0000 mgr.x (mgr.34733) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:26.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:26 smithi145 bash[35820]: cluster 2024-02-10T08:55:25.417497+0000 mgr.x (mgr.34733) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:28.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:28 smithi145 bash[35820]: cluster 2024-02-10T08:55:27.417817+0000 mgr.x (mgr.34733) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:28.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:28 smithi145 bash[35820]: audit 2024-02-10T08:55:28.377493+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:28.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:28 smithi145 bash[35820]: audit 2024-02-10T08:55:28.378182+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:28.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:28 smithi145 bash[35820]: audit 2024-02-10T08:55:28.381183+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:55:28.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[35794]: cluster 2024-02-10T08:55:27.417817+0000 mgr.x (mgr.34733) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:28.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[38951]: cluster 2024-02-10T08:55:27.417817+0000 mgr.x (mgr.34733) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:28.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[35794]: audit 2024-02-10T08:55:28.377493+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:28.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[38951]: audit 2024-02-10T08:55:28.377493+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:28.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[38951]: audit 2024-02-10T08:55:28.378182+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:28.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[38951]: audit 2024-02-10T08:55:28.381183+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:55:28.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[35794]: audit 2024-02-10T08:55:28.378182+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:28.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:28 smithi040 bash[35794]: audit 2024-02-10T08:55:28.381183+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 184234803, \"cpu_percentage\": \"1.45%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375357Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"4.96%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:55:28.375522Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 156552396, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375597Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49786388, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375664Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47007662, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375728Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47573893, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375792Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51118080, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375859Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14229176, \"cpu_percentage\": \"0.31%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.375957Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 18161336, \"cpu_percentage\": \"0.11%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376040Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 38409338, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:28.376103Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:28.376238Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.673785+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.674187+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.674478+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.674749+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.675005+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.675258+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.675543+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.675800+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:29 smithi145 bash[35820]: audit 2024-02-10T08:55:28.676112+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.673785+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.674187+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.674478+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.674749+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.675005+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.675258+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.675543+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.675800+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[35794]: audit 2024-02-10T08:55:28.676112+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.673785+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.674187+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.674478+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.674749+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.675005+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.675258+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.675543+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.675800+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:29.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:29 smithi040 bash[38951]: audit 2024-02-10T08:55:28.676112+0000 mon.b (mon.2) 245 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: cluster 2024-02-10T08:55:29.418657+0000 mgr.x (mgr.34733) 4 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.608538+0000 mon.b (mon.2) 246 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.609387+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.612736+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:55:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.892654+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.893020+0000 mon.b (mon.2) 248 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.893266+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.893538+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.893789+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.894034+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.894285+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.894542+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.894786+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.895876+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.896291+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.901550+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.907697+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.908084+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:30 smithi145 bash[35820]: audit 2024-02-10T08:55:29.913169+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:30.829 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: cluster 2024-02-10T08:55:29.418657+0000 mgr.x (mgr.34733) 4 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:30.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: cluster 2024-02-10T08:55:29.418657+0000 mgr.x (mgr.34733) 4 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:30.829 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.608538+0000 mon.b (mon.2) 246 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:30.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.608538+0000 mon.b (mon.2) 246 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:30.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.609387+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:30.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.609387+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.612736+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.892654+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.893020+0000 mon.b (mon.2) 248 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.893266+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.893538+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.893789+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.894034+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.831 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.894285+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.894542+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.894786+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.895876+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.896291+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.901550+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.907697+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.908084+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[38951]: audit 2024-02-10T08:55:29.913169+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:30.832 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.612736+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:45:43.111204Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.892654+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.893020+0000 mon.b (mon.2) 248 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.893266+0000 mon.b (mon.2) 249 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.893538+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.893789+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.894034+0000 mon.b (mon.2) 252 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.894285+0000 mon.b (mon.2) 253 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.894542+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.894786+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.895876+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.896291+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.901550+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.907697+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.908084+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:55:30.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:30 smithi040 bash[35794]: audit 2024-02-10T08:55:29.913169+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:55:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:32 smithi040 bash[35794]: cluster 2024-02-10T08:55:31.419045+0000 mgr.x (mgr.34733) 5 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:32 smithi040 bash[38951]: cluster 2024-02-10T08:55:31.419045+0000 mgr.x (mgr.34733) 5 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:32 smithi145 bash[35820]: cluster 2024-02-10T08:55:31.419045+0000 mgr.x (mgr.34733) 5 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:34 smithi145 bash[35820]: cluster 2024-02-10T08:55:33.419594+0000 mgr.x (mgr.34733) 6 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:34 smithi040 bash[35794]: cluster 2024-02-10T08:55:33.419594+0000 mgr.x (mgr.34733) 6 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:34.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:34 smithi040 bash[38951]: cluster 2024-02-10T08:55:33.419594+0000 mgr.x (mgr.34733) 6 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:36.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:36 smithi145 bash[35820]: cluster 2024-02-10T08:55:35.420388+0000 mgr.x (mgr.34733) 7 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:36.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:36 smithi040 bash[35794]: cluster 2024-02-10T08:55:35.420388+0000 mgr.x (mgr.34733) 7 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:36.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:36 smithi040 bash[38951]: cluster 2024-02-10T08:55:35.420388+0000 mgr.x (mgr.34733) 7 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:38 smithi145 bash[35820]: cluster 2024-02-10T08:55:37.420734+0000 mgr.x (mgr.34733) 8 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:38 smithi040 bash[35794]: cluster 2024-02-10T08:55:37.420734+0000 mgr.x (mgr.34733) 8 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:38 smithi040 bash[38951]: cluster 2024-02-10T08:55:37.420734+0000 mgr.x (mgr.34733) 8 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:40 smithi145 bash[35820]: cluster 2024-02-10T08:55:39.421592+0000 mgr.x (mgr.34733) 9 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:40.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:40 smithi040 bash[35794]: cluster 2024-02-10T08:55:39.421592+0000 mgr.x (mgr.34733) 9 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:40.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:40 smithi040 bash[38951]: cluster 2024-02-10T08:55:39.421592+0000 mgr.x (mgr.34733) 9 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:42 smithi040 bash[35794]: cluster 2024-02-10T08:55:41.422022+0000 mgr.x (mgr.34733) 10 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:42 smithi040 bash[38951]: cluster 2024-02-10T08:55:41.422022+0000 mgr.x (mgr.34733) 10 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:42 smithi145 bash[35820]: cluster 2024-02-10T08:55:41.422022+0000 mgr.x (mgr.34733) 10 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:44 smithi145 bash[35820]: cluster 2024-02-10T08:55:43.422616+0000 mgr.x (mgr.34733) 11 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:44 smithi040 bash[35794]: cluster 2024-02-10T08:55:43.422616+0000 mgr.x (mgr.34733) 11 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:44.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:44 smithi040 bash[38951]: cluster 2024-02-10T08:55:43.422616+0000 mgr.x (mgr.34733) 11 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:46 smithi145 bash[35820]: cluster 2024-02-10T08:55:45.423483+0000 mgr.x (mgr.34733) 12 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:46.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:46 smithi040 bash[35794]: cluster 2024-02-10T08:55:45.423483+0000 mgr.x (mgr.34733) 12 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:46.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:46 smithi040 bash[38951]: cluster 2024-02-10T08:55:45.423483+0000 mgr.x (mgr.34733) 12 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:48 smithi145 bash[35820]: cluster 2024-02-10T08:55:47.423916+0000 mgr.x (mgr.34733) 13 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:48.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:48 smithi040 bash[35794]: cluster 2024-02-10T08:55:47.423916+0000 mgr.x (mgr.34733) 13 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:48.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:48 smithi040 bash[38951]: cluster 2024-02-10T08:55:47.423916+0000 mgr.x (mgr.34733) 13 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:50 smithi145 bash[35820]: cluster 2024-02-10T08:55:49.424784+0000 mgr.x (mgr.34733) 14 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:50 smithi040 bash[35794]: cluster 2024-02-10T08:55:49.424784+0000 mgr.x (mgr.34733) 14 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:50.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:50 smithi040 bash[38951]: cluster 2024-02-10T08:55:49.424784+0000 mgr.x (mgr.34733) 14 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:52 smithi040 bash[35794]: cluster 2024-02-10T08:55:51.425171+0000 mgr.x (mgr.34733) 15 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:52 smithi040 bash[38951]: cluster 2024-02-10T08:55:51.425171+0000 mgr.x (mgr.34733) 15 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:52 smithi145 bash[35820]: cluster 2024-02-10T08:55:51.425171+0000 mgr.x (mgr.34733) 15 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:54 smithi145 bash[35820]: cluster 2024-02-10T08:55:53.425612+0000 mgr.x (mgr.34733) 16 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:54.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:54 smithi040 bash[35794]: cluster 2024-02-10T08:55:53.425612+0000 mgr.x (mgr.34733) 16 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:54 smithi040 bash[38951]: cluster 2024-02-10T08:55:53.425612+0000 mgr.x (mgr.34733) 16 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:56.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:56 smithi145 bash[35820]: cluster 2024-02-10T08:55:55.426340+0000 mgr.x (mgr.34733) 17 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:56.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:56 smithi040 bash[35794]: cluster 2024-02-10T08:55:55.426340+0000 mgr.x (mgr.34733) 17 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:56.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:56 smithi040 bash[38951]: cluster 2024-02-10T08:55:55.426340+0000 mgr.x (mgr.34733) 17 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:55:58 smithi145 bash[35820]: cluster 2024-02-10T08:55:57.426865+0000 mgr.x (mgr.34733) 18 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:58.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:55:58 smithi040 bash[35794]: cluster 2024-02-10T08:55:57.426865+0000 mgr.x (mgr.34733) 18 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:55:58.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:55:58 smithi040 bash[38951]: cluster 2024-02-10T08:55:57.426865+0000 mgr.x (mgr.34733) 18 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:00 smithi145 bash[35820]: cluster 2024-02-10T08:55:59.427496+0000 mgr.x (mgr.34733) 19 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:00.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:00 smithi040 bash[35794]: cluster 2024-02-10T08:55:59.427496+0000 mgr.x (mgr.34733) 19 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:00.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:00 smithi040 bash[38951]: cluster 2024-02-10T08:55:59.427496+0000 mgr.x (mgr.34733) 19 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:02 smithi040 bash[35794]: cluster 2024-02-10T08:56:01.427964+0000 mgr.x (mgr.34733) 20 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:02 smithi040 bash[38951]: cluster 2024-02-10T08:56:01.427964+0000 mgr.x (mgr.34733) 20 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:02 smithi145 bash[35820]: cluster 2024-02-10T08:56:01.427964+0000 mgr.x (mgr.34733) 20 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:04 smithi145 bash[35820]: cluster 2024-02-10T08:56:03.428463+0000 mgr.x (mgr.34733) 21 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:04.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:04 smithi040 bash[35794]: cluster 2024-02-10T08:56:03.428463+0000 mgr.x (mgr.34733) 21 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:04.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:04 smithi040 bash[38951]: cluster 2024-02-10T08:56:03.428463+0000 mgr.x (mgr.34733) 21 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:06.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:06 smithi145 bash[35820]: cluster 2024-02-10T08:56:05.429123+0000 mgr.x (mgr.34733) 22 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:06.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:06 smithi040 bash[35794]: cluster 2024-02-10T08:56:05.429123+0000 mgr.x (mgr.34733) 22 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:06.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:06 smithi040 bash[38951]: cluster 2024-02-10T08:56:05.429123+0000 mgr.x (mgr.34733) 22 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:08 smithi145 bash[35820]: cluster 2024-02-10T08:56:07.429598+0000 mgr.x (mgr.34733) 23 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:08.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:08 smithi040 bash[35794]: cluster 2024-02-10T08:56:07.429598+0000 mgr.x (mgr.34733) 23 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:08.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:08 smithi040 bash[38951]: cluster 2024-02-10T08:56:07.429598+0000 mgr.x (mgr.34733) 23 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:10 smithi145 bash[35820]: cluster 2024-02-10T08:56:09.430278+0000 mgr.x (mgr.34733) 24 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:10 smithi040 bash[35794]: cluster 2024-02-10T08:56:09.430278+0000 mgr.x (mgr.34733) 24 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:10.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:10 smithi040 bash[38951]: cluster 2024-02-10T08:56:09.430278+0000 mgr.x (mgr.34733) 24 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:12 smithi040 bash[35794]: cluster 2024-02-10T08:56:11.430752+0000 mgr.x (mgr.34733) 25 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:12 smithi040 bash[38951]: cluster 2024-02-10T08:56:11.430752+0000 mgr.x (mgr.34733) 25 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:12 smithi145 bash[35820]: cluster 2024-02-10T08:56:11.430752+0000 mgr.x (mgr.34733) 25 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:14 smithi145 bash[35820]: cluster 2024-02-10T08:56:13.431209+0000 mgr.x (mgr.34733) 26 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:14.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:14 smithi040 bash[35794]: cluster 2024-02-10T08:56:13.431209+0000 mgr.x (mgr.34733) 26 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:14.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:14 smithi040 bash[38951]: cluster 2024-02-10T08:56:13.431209+0000 mgr.x (mgr.34733) 26 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:16.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:16 smithi145 bash[35820]: cluster 2024-02-10T08:56:15.431993+0000 mgr.x (mgr.34733) 27 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:16.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:16 smithi040 bash[35794]: cluster 2024-02-10T08:56:15.431993+0000 mgr.x (mgr.34733) 27 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:16.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:16 smithi040 bash[38951]: cluster 2024-02-10T08:56:15.431993+0000 mgr.x (mgr.34733) 27 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:18 smithi145 bash[35820]: cluster 2024-02-10T08:56:17.432589+0000 mgr.x (mgr.34733) 28 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:18.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:18 smithi040 bash[35794]: cluster 2024-02-10T08:56:17.432589+0000 mgr.x (mgr.34733) 28 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:18.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:18 smithi040 bash[38951]: cluster 2024-02-10T08:56:17.432589+0000 mgr.x (mgr.34733) 28 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:20 smithi145 bash[35820]: cluster 2024-02-10T08:56:19.433271+0000 mgr.x (mgr.34733) 29 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:20.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:20 smithi040 bash[35794]: cluster 2024-02-10T08:56:19.433271+0000 mgr.x (mgr.34733) 29 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:20.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:20 smithi040 bash[38951]: cluster 2024-02-10T08:56:19.433271+0000 mgr.x (mgr.34733) 29 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:22 smithi040 bash[35794]: cluster 2024-02-10T08:56:21.433678+0000 mgr.x (mgr.34733) 30 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:22 smithi040 bash[38951]: cluster 2024-02-10T08:56:21.433678+0000 mgr.x (mgr.34733) 30 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:22 smithi145 bash[35820]: cluster 2024-02-10T08:56:21.433678+0000 mgr.x (mgr.34733) 30 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.459857+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-10T08:56:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.460117+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.460370+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.460489+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-10T08:56:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.460628+0000 mon.b (mon.2) 261 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-10T08:56:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.461170+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.461486+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:23 smithi145 bash[35820]: audit 2024-02-10T08:56:23.461808+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-10T08:56:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.459857+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-10T08:56:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.460117+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.460370+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.460489+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.460628+0000 mon.b (mon.2) 261 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.461170+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.461486+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[35794]: audit 2024-02-10T08:56:23.461808+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.459857+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.460117+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.460370+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.460489+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.460628+0000 mon.b (mon.2) 261 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.461170+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.461486+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-10T08:56:23.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:23 smithi040 bash[38951]: audit 2024-02-10T08:56:23.461808+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-10T08:56:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:24 smithi145 bash[35820]: cluster 2024-02-10T08:56:23.434051+0000 mgr.x (mgr.34733) 31 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:24 smithi040 bash[35794]: cluster 2024-02-10T08:56:23.434051+0000 mgr.x (mgr.34733) 31 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:24 smithi040 bash[38951]: cluster 2024-02-10T08:56:23.434051+0000 mgr.x (mgr.34733) 31 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:26.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:26 smithi145 bash[35820]: cluster 2024-02-10T08:56:25.434737+0000 mgr.x (mgr.34733) 32 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:26.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:26 smithi040 bash[35794]: cluster 2024-02-10T08:56:25.434737+0000 mgr.x (mgr.34733) 32 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:26 smithi040 bash[38951]: cluster 2024-02-10T08:56:25.434737+0000 mgr.x (mgr.34733) 32 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:28 smithi145 bash[35820]: cluster 2024-02-10T08:56:27.435097+0000 mgr.x (mgr.34733) 33 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:28.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:28 smithi040 bash[35794]: cluster 2024-02-10T08:56:27.435097+0000 mgr.x (mgr.34733) 33 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:28.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:28 smithi040 bash[38951]: cluster 2024-02-10T08:56:27.435097+0000 mgr.x (mgr.34733) 33 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: cluster 2024-02-10T08:56:29.435884+0000 mgr.x (mgr.34733) 34 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: audit 2024-02-10T08:56:30.153125+0000 mon.b (mon.2) 262 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:56:30.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: audit 2024-02-10T08:56:30.153815+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:56:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: audit 2024-02-10T08:56:30.157645+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:56:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: audit 2024-02-10T08:56:30.426170+0000 mon.b (mon.2) 263 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:56:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: audit 2024-02-10T08:56:30.426640+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:56:30.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:30 smithi145 bash[35820]: audit 2024-02-10T08:56:30.430466+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:56:30.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: cluster 2024-02-10T08:56:29.435884+0000 mgr.x (mgr.34733) 34 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:30.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: cluster 2024-02-10T08:56:29.435884+0000 mgr.x (mgr.34733) 34 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:30.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: audit 2024-02-10T08:56:30.153125+0000 mon.b (mon.2) 262 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:56:30.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: audit 2024-02-10T08:56:30.153125+0000 mon.b (mon.2) 262 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: audit 2024-02-10T08:56:30.153815+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: audit 2024-02-10T08:56:30.157645+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: audit 2024-02-10T08:56:30.426170+0000 mon.b (mon.2) 263 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: audit 2024-02-10T08:56:30.426640+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[38951]: audit 2024-02-10T08:56:30.430466+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: audit 2024-02-10T08:56:30.153815+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:56:30.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: audit 2024-02-10T08:56:30.157645+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 158125260, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606572Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 425302425, \"cpu_percentage\": \"2.73%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.606731Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49440358, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606799Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47437578, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606862Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46850375, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606923Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46986690, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.606983Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 55511613, \"cpu_percentage\": \"0.30%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607044Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14606663, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607104Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36773560, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:55:29.607163Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39069941, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:55:29.607221Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:55:29.607358Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:56:30.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: audit 2024-02-10T08:56:30.426170+0000 mon.b (mon.2) 263 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:56:30.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: audit 2024-02-10T08:56:30.426640+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:56:30.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:30 smithi040 bash[35794]: audit 2024-02-10T08:56:30.430466+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:56:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:32 smithi040 bash[35794]: cluster 2024-02-10T08:56:31.436304+0000 mgr.x (mgr.34733) 35 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:32 smithi040 bash[38951]: cluster 2024-02-10T08:56:31.436304+0000 mgr.x (mgr.34733) 35 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:32 smithi145 bash[35820]: cluster 2024-02-10T08:56:31.436304+0000 mgr.x (mgr.34733) 35 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:34 smithi145 bash[35820]: cluster 2024-02-10T08:56:33.436871+0000 mgr.x (mgr.34733) 36 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:34 smithi040 bash[35794]: cluster 2024-02-10T08:56:33.436871+0000 mgr.x (mgr.34733) 36 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:34.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:34 smithi040 bash[38951]: cluster 2024-02-10T08:56:33.436871+0000 mgr.x (mgr.34733) 36 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:36.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:36 smithi145 bash[35820]: cluster 2024-02-10T08:56:35.437796+0000 mgr.x (mgr.34733) 37 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:36.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:36 smithi040 bash[35794]: cluster 2024-02-10T08:56:35.437796+0000 mgr.x (mgr.34733) 37 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:36.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:36 smithi040 bash[38951]: cluster 2024-02-10T08:56:35.437796+0000 mgr.x (mgr.34733) 37 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:38.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:38 smithi145 bash[35820]: cluster 2024-02-10T08:56:37.438379+0000 mgr.x (mgr.34733) 38 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:38.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:38 smithi040 bash[35794]: cluster 2024-02-10T08:56:37.438379+0000 mgr.x (mgr.34733) 38 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:38 smithi040 bash[38951]: cluster 2024-02-10T08:56:37.438379+0000 mgr.x (mgr.34733) 38 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:40 smithi145 bash[35820]: cluster 2024-02-10T08:56:39.439052+0000 mgr.x (mgr.34733) 39 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:40.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:40 smithi040 bash[35794]: cluster 2024-02-10T08:56:39.439052+0000 mgr.x (mgr.34733) 39 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:40.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:40 smithi040 bash[38951]: cluster 2024-02-10T08:56:39.439052+0000 mgr.x (mgr.34733) 39 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:42 smithi040 bash[35794]: cluster 2024-02-10T08:56:41.439635+0000 mgr.x (mgr.34733) 40 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:42 smithi040 bash[38951]: cluster 2024-02-10T08:56:41.439635+0000 mgr.x (mgr.34733) 40 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:42 smithi145 bash[35820]: cluster 2024-02-10T08:56:41.439635+0000 mgr.x (mgr.34733) 40 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:44 smithi145 bash[35820]: cluster 2024-02-10T08:56:43.440196+0000 mgr.x (mgr.34733) 41 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:44 smithi040 bash[35794]: cluster 2024-02-10T08:56:43.440196+0000 mgr.x (mgr.34733) 41 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:44 smithi040 bash[38951]: cluster 2024-02-10T08:56:43.440196+0000 mgr.x (mgr.34733) 41 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:46 smithi145 bash[35820]: cluster 2024-02-10T08:56:45.441048+0000 mgr.x (mgr.34733) 42 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:46.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:46 smithi040 bash[35794]: cluster 2024-02-10T08:56:45.441048+0000 mgr.x (mgr.34733) 42 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:46.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:46 smithi040 bash[38951]: cluster 2024-02-10T08:56:45.441048+0000 mgr.x (mgr.34733) 42 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:48 smithi145 bash[35820]: cluster 2024-02-10T08:56:47.441621+0000 mgr.x (mgr.34733) 43 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:48.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:48 smithi040 bash[35794]: cluster 2024-02-10T08:56:47.441621+0000 mgr.x (mgr.34733) 43 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:48.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:48 smithi040 bash[38951]: cluster 2024-02-10T08:56:47.441621+0000 mgr.x (mgr.34733) 43 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:50 smithi145 bash[35820]: cluster 2024-02-10T08:56:49.442248+0000 mgr.x (mgr.34733) 44 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:50 smithi040 bash[35794]: cluster 2024-02-10T08:56:49.442248+0000 mgr.x (mgr.34733) 44 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:50.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:50 smithi040 bash[38951]: cluster 2024-02-10T08:56:49.442248+0000 mgr.x (mgr.34733) 44 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:52.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:52 smithi040 bash[35794]: cluster 2024-02-10T08:56:51.442762+0000 mgr.x (mgr.34733) 45 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:52.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:52 smithi040 bash[38951]: cluster 2024-02-10T08:56:51.442762+0000 mgr.x (mgr.34733) 45 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:52 smithi145 bash[35820]: cluster 2024-02-10T08:56:51.442762+0000 mgr.x (mgr.34733) 45 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:54 smithi145 bash[35820]: cluster 2024-02-10T08:56:53.443150+0000 mgr.x (mgr.34733) 46 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:54.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:54 smithi040 bash[35794]: cluster 2024-02-10T08:56:53.443150+0000 mgr.x (mgr.34733) 46 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:54 smithi040 bash[38951]: cluster 2024-02-10T08:56:53.443150+0000 mgr.x (mgr.34733) 46 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:56.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:56 smithi145 bash[35820]: cluster 2024-02-10T08:56:55.443863+0000 mgr.x (mgr.34733) 47 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:56.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:56 smithi040 bash[35794]: cluster 2024-02-10T08:56:55.443863+0000 mgr.x (mgr.34733) 47 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:56.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:56 smithi040 bash[38951]: cluster 2024-02-10T08:56:55.443863+0000 mgr.x (mgr.34733) 47 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:56:58 smithi145 bash[35820]: cluster 2024-02-10T08:56:57.444289+0000 mgr.x (mgr.34733) 48 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:58.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:56:58 smithi040 bash[35794]: cluster 2024-02-10T08:56:57.444289+0000 mgr.x (mgr.34733) 48 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:56:58.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:56:58 smithi040 bash[38951]: cluster 2024-02-10T08:56:57.444289+0000 mgr.x (mgr.34733) 48 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:00 smithi145 bash[35820]: cluster 2024-02-10T08:56:59.444965+0000 mgr.x (mgr.34733) 49 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:00.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:00 smithi040 bash[35794]: cluster 2024-02-10T08:56:59.444965+0000 mgr.x (mgr.34733) 49 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:00.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:00 smithi040 bash[38951]: cluster 2024-02-10T08:56:59.444965+0000 mgr.x (mgr.34733) 49 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:02 smithi040 bash[35794]: cluster 2024-02-10T08:57:01.445426+0000 mgr.x (mgr.34733) 50 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:02.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:02 smithi040 bash[38951]: cluster 2024-02-10T08:57:01.445426+0000 mgr.x (mgr.34733) 50 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:02 smithi145 bash[35820]: cluster 2024-02-10T08:57:01.445426+0000 mgr.x (mgr.34733) 50 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:04 smithi145 bash[35820]: cluster 2024-02-10T08:57:03.445967+0000 mgr.x (mgr.34733) 51 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:04.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:04 smithi040 bash[35794]: cluster 2024-02-10T08:57:03.445967+0000 mgr.x (mgr.34733) 51 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:04.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:04 smithi040 bash[38951]: cluster 2024-02-10T08:57:03.445967+0000 mgr.x (mgr.34733) 51 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:06.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:06 smithi145 bash[35820]: cluster 2024-02-10T08:57:05.446681+0000 mgr.x (mgr.34733) 52 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:06.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:06 smithi040 bash[35794]: cluster 2024-02-10T08:57:05.446681+0000 mgr.x (mgr.34733) 52 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:06.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:06 smithi040 bash[38951]: cluster 2024-02-10T08:57:05.446681+0000 mgr.x (mgr.34733) 52 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:08 smithi145 bash[35820]: cluster 2024-02-10T08:57:07.447304+0000 mgr.x (mgr.34733) 53 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:08.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:08 smithi040 bash[35794]: cluster 2024-02-10T08:57:07.447304+0000 mgr.x (mgr.34733) 53 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:08.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:08 smithi040 bash[38951]: cluster 2024-02-10T08:57:07.447304+0000 mgr.x (mgr.34733) 53 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:10 smithi145 bash[35820]: cluster 2024-02-10T08:57:09.448009+0000 mgr.x (mgr.34733) 54 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:10 smithi040 bash[35794]: cluster 2024-02-10T08:57:09.448009+0000 mgr.x (mgr.34733) 54 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:10.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:10 smithi040 bash[38951]: cluster 2024-02-10T08:57:09.448009+0000 mgr.x (mgr.34733) 54 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:12.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:12 smithi040 bash[35794]: cluster 2024-02-10T08:57:11.448506+0000 mgr.x (mgr.34733) 55 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:12.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:12 smithi040 bash[38951]: cluster 2024-02-10T08:57:11.448506+0000 mgr.x (mgr.34733) 55 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:12 smithi145 bash[35820]: cluster 2024-02-10T08:57:11.448506+0000 mgr.x (mgr.34733) 55 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:14.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:14 smithi145 bash[35820]: cluster 2024-02-10T08:57:13.448940+0000 mgr.x (mgr.34733) 56 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:14.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:14 smithi040 bash[35794]: cluster 2024-02-10T08:57:13.448940+0000 mgr.x (mgr.34733) 56 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:14.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:14 smithi040 bash[38951]: cluster 2024-02-10T08:57:13.448940+0000 mgr.x (mgr.34733) 56 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:16.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:16 smithi145 bash[35820]: cluster 2024-02-10T08:57:15.449804+0000 mgr.x (mgr.34733) 57 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:16.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:16 smithi040 bash[35794]: cluster 2024-02-10T08:57:15.449804+0000 mgr.x (mgr.34733) 57 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:16.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:16 smithi040 bash[38951]: cluster 2024-02-10T08:57:15.449804+0000 mgr.x (mgr.34733) 57 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:18 smithi145 bash[35820]: cluster 2024-02-10T08:57:17.450365+0000 mgr.x (mgr.34733) 58 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:18.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:18 smithi040 bash[35794]: cluster 2024-02-10T08:57:17.450365+0000 mgr.x (mgr.34733) 58 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:18.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:18 smithi040 bash[38951]: cluster 2024-02-10T08:57:17.450365+0000 mgr.x (mgr.34733) 58 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:20 smithi145 bash[35820]: cluster 2024-02-10T08:57:19.451002+0000 mgr.x (mgr.34733) 59 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:20.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:20 smithi040 bash[35794]: cluster 2024-02-10T08:57:19.451002+0000 mgr.x (mgr.34733) 59 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:20.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:20 smithi040 bash[38951]: cluster 2024-02-10T08:57:19.451002+0000 mgr.x (mgr.34733) 59 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:22.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:22 smithi040 bash[35794]: cluster 2024-02-10T08:57:21.451415+0000 mgr.x (mgr.34733) 60 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:22.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:22 smithi040 bash[38951]: cluster 2024-02-10T08:57:21.451415+0000 mgr.x (mgr.34733) 60 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:22 smithi145 bash[35820]: cluster 2024-02-10T08:57:21.451415+0000 mgr.x (mgr.34733) 60 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.464154+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T08:57:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.464414+0000 mon.b (mon.2) 265 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:57:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.464583+0000 mon.b (mon.2) 266 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.464663+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T08:57:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.464774+0000 mon.b (mon.2) 267 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.465355+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:57:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.465649+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:23 smithi145 bash[35820]: audit 2024-02-10T08:57:23.465948+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.464154+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.464414+0000 mon.b (mon.2) 265 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.464583+0000 mon.b (mon.2) 266 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.464663+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.464774+0000 mon.b (mon.2) 267 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.465355+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.465649+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[35794]: audit 2024-02-10T08:57:23.465948+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.464154+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.464414+0000 mon.b (mon.2) 265 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.464583+0000 mon.b (mon.2) 266 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.464663+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T08:57:23.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.464774+0000 mon.b (mon.2) 267 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.465355+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T08:57:23.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.465649+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T08:57:23.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:23 smithi040 bash[38951]: audit 2024-02-10T08:57:23.465948+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T08:57:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:24 smithi145 bash[35820]: cluster 2024-02-10T08:57:23.451960+0000 mgr.x (mgr.34733) 61 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:24 smithi040 bash[35794]: cluster 2024-02-10T08:57:23.451960+0000 mgr.x (mgr.34733) 61 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:24 smithi040 bash[38951]: cluster 2024-02-10T08:57:23.451960+0000 mgr.x (mgr.34733) 61 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:26.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:26 smithi145 bash[35820]: cluster 2024-02-10T08:57:25.452798+0000 mgr.x (mgr.34733) 62 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:26.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:26 smithi040 bash[35794]: cluster 2024-02-10T08:57:25.452798+0000 mgr.x (mgr.34733) 62 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:26 smithi040 bash[38951]: cluster 2024-02-10T08:57:25.452798+0000 mgr.x (mgr.34733) 62 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:27.425 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:57:26 smithi040 bash[59999]: ts=2024-02-10T08:57:26.952Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="web.hook/webhook[0]: notify retry canceled after 16 attempts: Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:57:27.425 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:57:26 smithi040 bash[59999]: ts=2024-02-10T08:57:26.953Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:57:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:28 smithi145 bash[35820]: cluster 2024-02-10T08:57:27.453211+0000 mgr.x (mgr.34733) 63 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:28.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:28 smithi040 bash[35794]: cluster 2024-02-10T08:57:27.453211+0000 mgr.x (mgr.34733) 63 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:28.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:28 smithi040 bash[38951]: cluster 2024-02-10T08:57:27.453211+0000 mgr.x (mgr.34733) 63 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:30.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:30 smithi040 bash[35794]: cluster 2024-02-10T08:57:29.453878+0000 mgr.x (mgr.34733) 64 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:30.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:30 smithi040 bash[38951]: cluster 2024-02-10T08:57:29.453878+0000 mgr.x (mgr.34733) 64 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:31.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:30 smithi145 bash[35820]: cluster 2024-02-10T08:57:29.453878+0000 mgr.x (mgr.34733) 64 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:31.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:31 smithi040 bash[35794]: audit 2024-02-10T08:57:30.730912+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:57:31.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:31 smithi040 bash[35794]: audit 2024-02-10T08:57:30.731586+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:57:31.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:31 smithi040 bash[35794]: audit 2024-02-10T08:57:30.735260+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:57:31.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:31 smithi040 bash[38951]: audit 2024-02-10T08:57:30.730912+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:57:31.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:31 smithi040 bash[38951]: audit 2024-02-10T08:57:30.731586+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:57:31.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:31 smithi040 bash[38951]: audit 2024-02-10T08:57:30.735260+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:57:32.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:31 smithi145 bash[35820]: audit 2024-02-10T08:57:30.730912+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:57:32.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:31 smithi145 bash[35820]: audit 2024-02-10T08:57:30.731586+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:57:32.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:31 smithi145 bash[35820]: audit 2024-02-10T08:57:30.735260+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:57:32.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:32 smithi040 bash[35794]: cluster 2024-02-10T08:57:31.454350+0000 mgr.x (mgr.34733) 65 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:32.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:32 smithi040 bash[38951]: cluster 2024-02-10T08:57:31.454350+0000 mgr.x (mgr.34733) 65 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:33.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:32 smithi145 bash[35820]: cluster 2024-02-10T08:57:31.454350+0000 mgr.x (mgr.34733) 65 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:34 smithi040 bash[35794]: cluster 2024-02-10T08:57:33.454740+0000 mgr.x (mgr.34733) 66 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:34.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:34 smithi040 bash[38951]: cluster 2024-02-10T08:57:33.454740+0000 mgr.x (mgr.34733) 66 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:35.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:34 smithi145 bash[35820]: cluster 2024-02-10T08:57:33.454740+0000 mgr.x (mgr.34733) 66 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:36.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:36 smithi040 bash[35794]: cluster 2024-02-10T08:57:35.455586+0000 mgr.x (mgr.34733) 67 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:36.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:36 smithi040 bash[38951]: cluster 2024-02-10T08:57:35.455586+0000 mgr.x (mgr.34733) 67 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:36 smithi145 bash[35820]: cluster 2024-02-10T08:57:35.455586+0000 mgr.x (mgr.34733) 67 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:37.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:37 smithi040 bash[35794]: cluster 2024-02-10T08:57:37.456051+0000 mgr.x (mgr.34733) 68 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:37.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:37 smithi040 bash[38951]: cluster 2024-02-10T08:57:37.456051+0000 mgr.x (mgr.34733) 68 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:38.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:37 smithi145 bash[35820]: cluster 2024-02-10T08:57:37.456051+0000 mgr.x (mgr.34733) 68 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:40 smithi145 bash[35820]: cluster 2024-02-10T08:57:39.456716+0000 mgr.x (mgr.34733) 69 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:40.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:40 smithi040 bash[35794]: cluster 2024-02-10T08:57:39.456716+0000 mgr.x (mgr.34733) 69 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:40.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:40 smithi040 bash[38951]: cluster 2024-02-10T08:57:39.456716+0000 mgr.x (mgr.34733) 69 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:42 smithi040 bash[35794]: cluster 2024-02-10T08:57:41.457120+0000 mgr.x (mgr.34733) 70 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:42.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:42 smithi040 bash[38951]: cluster 2024-02-10T08:57:41.457120+0000 mgr.x (mgr.34733) 70 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:42.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:42 smithi145 bash[35820]: cluster 2024-02-10T08:57:41.457120+0000 mgr.x (mgr.34733) 70 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:44 smithi145 bash[35820]: cluster 2024-02-10T08:57:43.457749+0000 mgr.x (mgr.34733) 71 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:44 smithi040 bash[35794]: cluster 2024-02-10T08:57:43.457749+0000 mgr.x (mgr.34733) 71 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:44 smithi040 bash[38951]: cluster 2024-02-10T08:57:43.457749+0000 mgr.x (mgr.34733) 71 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:46 smithi145 bash[35820]: cluster 2024-02-10T08:57:45.458576+0000 mgr.x (mgr.34733) 72 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:46.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:46 smithi040 bash[35794]: cluster 2024-02-10T08:57:45.458576+0000 mgr.x (mgr.34733) 72 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:46.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:46 smithi040 bash[38951]: cluster 2024-02-10T08:57:45.458576+0000 mgr.x (mgr.34733) 72 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:48.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:48 smithi145 bash[35820]: cluster 2024-02-10T08:57:47.459008+0000 mgr.x (mgr.34733) 73 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:48.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:48 smithi040 bash[35794]: cluster 2024-02-10T08:57:47.459008+0000 mgr.x (mgr.34733) 73 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:48.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:48 smithi040 bash[38951]: cluster 2024-02-10T08:57:47.459008+0000 mgr.x (mgr.34733) 73 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:50 smithi145 bash[35820]: cluster 2024-02-10T08:57:49.459779+0000 mgr.x (mgr.34733) 74 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:50 smithi040 bash[35794]: cluster 2024-02-10T08:57:49.459779+0000 mgr.x (mgr.34733) 74 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:50.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:50 smithi040 bash[38951]: cluster 2024-02-10T08:57:49.459779+0000 mgr.x (mgr.34733) 74 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:52.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:52 smithi040 bash[35794]: cluster 2024-02-10T08:57:51.460167+0000 mgr.x (mgr.34733) 75 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:52.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:52 smithi040 bash[38951]: cluster 2024-02-10T08:57:51.460167+0000 mgr.x (mgr.34733) 75 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:52 smithi145 bash[35820]: cluster 2024-02-10T08:57:51.460167+0000 mgr.x (mgr.34733) 75 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:53.675 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:57:53 smithi040 bash[59999]: ts=2024-02-10T08:57:53.249Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="web.hook/webhook[0]: notify retry canceled after 17 attempts: Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:57:53.675 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:57:53 smithi040 bash[59999]: ts=2024-02-10T08:57:53.249Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephMgrPrometheusModuleInactive\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-10T08:57:54.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:54 smithi145 bash[35820]: cluster 2024-02-10T08:57:53.460653+0000 mgr.x (mgr.34733) 76 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:54.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:54 smithi040 bash[35794]: cluster 2024-02-10T08:57:53.460653+0000 mgr.x (mgr.34733) 76 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:54 smithi040 bash[38951]: cluster 2024-02-10T08:57:53.460653+0000 mgr.x (mgr.34733) 76 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:56.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:56 smithi145 bash[35820]: cluster 2024-02-10T08:57:55.461352+0000 mgr.x (mgr.34733) 77 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:56.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:56 smithi040 bash[35794]: cluster 2024-02-10T08:57:55.461352+0000 mgr.x (mgr.34733) 77 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:56.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:56 smithi040 bash[38951]: cluster 2024-02-10T08:57:55.461352+0000 mgr.x (mgr.34733) 77 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:58.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:57:58 smithi145 bash[35820]: cluster 2024-02-10T08:57:57.461699+0000 mgr.x (mgr.34733) 78 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:58.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:57:58 smithi040 bash[35794]: cluster 2024-02-10T08:57:57.461699+0000 mgr.x (mgr.34733) 78 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:57:58.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:57:58 smithi040 bash[38951]: cluster 2024-02-10T08:57:57.461699+0000 mgr.x (mgr.34733) 78 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:00.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:00 smithi145 bash[35820]: cluster 2024-02-10T08:57:59.462391+0000 mgr.x (mgr.34733) 79 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:00.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:00 smithi040 bash[35794]: cluster 2024-02-10T08:57:59.462391+0000 mgr.x (mgr.34733) 79 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:00.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:00 smithi040 bash[38951]: cluster 2024-02-10T08:57:59.462391+0000 mgr.x (mgr.34733) 79 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:02.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:02 smithi040 bash[35794]: cluster 2024-02-10T08:58:01.462749+0000 mgr.x (mgr.34733) 80 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:02.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:02 smithi040 bash[38951]: cluster 2024-02-10T08:58:01.462749+0000 mgr.x (mgr.34733) 80 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:02.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:02 smithi145 bash[35820]: cluster 2024-02-10T08:58:01.462749+0000 mgr.x (mgr.34733) 80 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:04.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:04 smithi145 bash[35820]: cluster 2024-02-10T08:58:03.463203+0000 mgr.x (mgr.34733) 81 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:04.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:04 smithi040 bash[35794]: cluster 2024-02-10T08:58:03.463203+0000 mgr.x (mgr.34733) 81 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:04.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:04 smithi040 bash[38951]: cluster 2024-02-10T08:58:03.463203+0000 mgr.x (mgr.34733) 81 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:06.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:06 smithi145 bash[35820]: cluster 2024-02-10T08:58:05.464062+0000 mgr.x (mgr.34733) 82 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:06.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:06 smithi040 bash[35794]: cluster 2024-02-10T08:58:05.464062+0000 mgr.x (mgr.34733) 82 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:06.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:06 smithi040 bash[38951]: cluster 2024-02-10T08:58:05.464062+0000 mgr.x (mgr.34733) 82 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:08 smithi145 bash[35820]: cluster 2024-02-10T08:58:07.464643+0000 mgr.x (mgr.34733) 83 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:08.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:08 smithi040 bash[35794]: cluster 2024-02-10T08:58:07.464643+0000 mgr.x (mgr.34733) 83 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:08.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:08 smithi040 bash[38951]: cluster 2024-02-10T08:58:07.464643+0000 mgr.x (mgr.34733) 83 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:10 smithi040 bash[35794]: cluster 2024-02-10T08:58:09.465222+0000 mgr.x (mgr.34733) 84 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:10.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:10 smithi040 bash[38951]: cluster 2024-02-10T08:58:09.465222+0000 mgr.x (mgr.34733) 84 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:11.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:10 smithi145 bash[35820]: cluster 2024-02-10T08:58:09.465222+0000 mgr.x (mgr.34733) 84 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:12.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:12 smithi040 bash[35794]: cluster 2024-02-10T08:58:11.465627+0000 mgr.x (mgr.34733) 85 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:12.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:12 smithi040 bash[38951]: cluster 2024-02-10T08:58:11.465627+0000 mgr.x (mgr.34733) 85 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:12 smithi145 bash[35820]: cluster 2024-02-10T08:58:11.465627+0000 mgr.x (mgr.34733) 85 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:14 smithi145 bash[35820]: cluster 2024-02-10T08:58:13.466157+0000 mgr.x (mgr.34733) 86 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:14.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:14 smithi040 bash[35794]: cluster 2024-02-10T08:58:13.466157+0000 mgr.x (mgr.34733) 86 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:14.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:14 smithi040 bash[38951]: cluster 2024-02-10T08:58:13.466157+0000 mgr.x (mgr.34733) 86 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:16.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:16 smithi145 bash[35820]: cluster 2024-02-10T08:58:15.467031+0000 mgr.x (mgr.34733) 87 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:16.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:16 smithi040 bash[35794]: cluster 2024-02-10T08:58:15.467031+0000 mgr.x (mgr.34733) 87 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:16.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:16 smithi040 bash[38951]: cluster 2024-02-10T08:58:15.467031+0000 mgr.x (mgr.34733) 87 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-10T08:58:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:18 smithi145 bash[35820]: cluster 2024-02-10T08:58:17.467547+0000 mgr.x (mgr.34733) 88 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:18.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:18 smithi040 bash[35794]: cluster 2024-02-10T08:58:17.467547+0000 mgr.x (mgr.34733) 88 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:18.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:18 smithi040 bash[38951]: cluster 2024-02-10T08:58:17.467547+0000 mgr.x (mgr.34733) 88 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:20.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T08:58:20.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:20 smithi040 bash[35794]: cluster 2024-02-10T08:58:19.468186+0000 mgr.x (mgr.34733) 89 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:20.914 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:20 smithi040 bash[38951]: cluster 2024-02-10T08:58:19.468186+0000 mgr.x (mgr.34733) 89 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:21.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:20 smithi145 bash[35820]: cluster 2024-02-10T08:58:19.468186+0000 mgr.x (mgr.34733) 89 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:22.416 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:22 smithi040 bash[35794]: cluster 2024-02-10T08:58:21.468625+0000 mgr.x (mgr.34733) 90 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:22.416 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:22 smithi040 bash[38951]: cluster 2024-02-10T08:58:21.468625+0000 mgr.x (mgr.34733) 90 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:22.617 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (12m) 2m ago 21m 17.3M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (21m) 2m ago 21m 35.0M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (16m) 2m ago 25m 405M - 16.2.14-521-g0e714d9a 1fbc92c859dc b9b23ff414a1 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (8m) 2m ago 27m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (27m) 2m ago 27m 175M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (25m) 2m ago 25m 150M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (25m) 2m ago 25m 149M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (22m) 2m ago 22m 13.5M - 1.7.0 72c9c2088986 499f0f53e04a 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (22m) 2m ago 22m 13.9M - 1.7.0 72c9c2088986 b3a2408fef6b 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (25m) 2m ago 25m 47.4M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (24m) 2m ago 24m 44.8M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (24m) 2m ago 24m 45.3M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (24m) 2m ago 24m 48.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:58:22.618 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (23m) 2m ago 23m 47.1M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (23m) 2m ago 23m 45.2M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (23m) 2m ago 23m 44.6M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (22m) 2m ago 22m 44.8M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (12m) 2m ago 22m 52.9M - 2.49.1 2a72b385beaf 37cd9848751b 2024-02-10T08:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (20m) 2m ago 20m 36.6M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:58:22.619 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (20m) 2m ago 20m 37.2M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:58:22.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:22 smithi145 bash[35820]: cluster 2024-02-10T08:58:21.468625+0000 mgr.x (mgr.34733) 90 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:23.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.606834+0000 mon.b (mon.2) 269 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.607269+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.607647+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.608031+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.608382+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.608731+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.610851+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.611248+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.577 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.611622+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.611970+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[35794]: audit 2024-02-10T08:58:22.612314+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.606834+0000 mon.b (mon.2) 269 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.607269+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.607647+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.608031+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.608382+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.608731+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.610851+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.578 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.611248+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.611622+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.611970+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.579 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:23 smithi040 bash[38951]: audit 2024-02-10T08:58:22.612314+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.606834+0000 mon.b (mon.2) 269 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.607269+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.607647+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.608031+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.608382+0000 mon.b (mon.2) 273 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.608731+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.610851+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.611248+0000 mon.b (mon.2) 276 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.611622+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.611970+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:23.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:23 smithi145 bash[35820]: audit 2024-02-10T08:58:22.612314+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:24.554 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:22.604283+0000 mgr.x (mgr.34733) 91 : audit [DBG] from='client.24805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.467884+0000 mon.b (mon.2) 280 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468148+0000 mon.b (mon.2) 281 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468260+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468334+0000 mon.b (mon.2) 282 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468522+0000 mon.b (mon.2) 283 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [3, 2]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468548+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468718+0000 mon.b (mon.2) 284 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468747+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.468943+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [3, 2]}]: dispatch 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: cluster 2024-02-10T08:58:23.469011+0000 mgr.x (mgr.34733) 92 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:24.555 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[38951]: audit 2024-02-10T08:58:23.469168+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:22.604283+0000 mgr.x (mgr.34733) 91 : audit [DBG] from='client.24805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.467884+0000 mon.b (mon.2) 280 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468148+0000 mon.b (mon.2) 281 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468260+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468334+0000 mon.b (mon.2) 282 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468522+0000 mon.b (mon.2) 283 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [3, 2]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468548+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468718+0000 mon.b (mon.2) 284 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468747+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.468943+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [3, 2]}]: dispatch 2024-02-10T08:58:24.556 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: cluster 2024-02-10T08:58:23.469011+0000 mgr.x (mgr.34733) 92 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:24.557 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:24 smithi040 bash[35794]: audit 2024-02-10T08:58:23.469168+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:22.604283+0000 mgr.x (mgr.34733) 91 : audit [DBG] from='client.24805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.467884+0000 mon.b (mon.2) 280 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-02-10T08:58:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468148+0000 mon.b (mon.2) 281 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468260+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2024-02-10T08:58:24.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468334+0000 mon.b (mon.2) 282 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468522+0000 mon.b (mon.2) 283 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [3, 2]}]: dispatch 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468548+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468718+0000 mon.b (mon.2) 284 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468747+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 0]}]: dispatch 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.468943+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [3, 2]}]: dispatch 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: cluster 2024-02-10T08:58:23.469011+0000 mgr.x (mgr.34733) 92 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:24 smithi145 bash[35820]: audit 2024-02-10T08:58:23.469168+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:58:25.301 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:58:25.302 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:58:25.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:25 smithi040 bash[35794]: audit 2024-02-10T08:58:25.300595+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.15.40:0/2225750406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:58:25.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:25 smithi040 bash[38951]: audit 2024-02-10T08:58:25.300595+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.15.40:0/2225750406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:58:25.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:25 smithi145 bash[35820]: audit 2024-02-10T08:58:25.300595+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.15.40:0/2225750406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:58:25.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-10T08:58:26.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:26 smithi040 bash[35794]: cluster 2024-02-10T08:58:25.469778+0000 mgr.x (mgr.34733) 93 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:26.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:26 smithi040 bash[38951]: cluster 2024-02-10T08:58:25.469778+0000 mgr.x (mgr.34733) 93 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:26.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:26 smithi145 bash[35820]: cluster 2024-02-10T08:58:25.469778+0000 mgr.x (mgr.34733) 93 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:28.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:28 smithi145 bash[35820]: cluster 2024-02-10T08:58:27.470215+0000 mgr.x (mgr.34733) 94 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:28.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:28 smithi040 bash[35794]: cluster 2024-02-10T08:58:27.470215+0000 mgr.x (mgr.34733) 94 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:28.889 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:28 smithi040 bash[38951]: cluster 2024-02-10T08:58:27.470215+0000 mgr.x (mgr.34733) 94 : cluster [DBG] pgmap v95: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:27.813494+0000 mgr.x (mgr.34733) 95 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:29.359231+0000 mon.b (mon.2) 285 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:29.359821+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:29.363085+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:29.392944+0000 mon.b (mon.2) 286 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:29.393598+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[35794]: audit 2024-02-10T08:58:29.396884+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:27.813494+0000 mgr.x (mgr.34733) 95 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:29.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:29.359231+0000 mon.b (mon.2) 285 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:29.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:29.359821+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:29.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:29.363085+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T08:58:29.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:29.392944+0000 mon.b (mon.2) 286 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:29.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:29.393598+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:29.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:29 smithi040 bash[38951]: audit 2024-02-10T08:58:29.396884+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:58:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:27.813494+0000 mgr.x (mgr.34733) 95 : audit [DBG] from='client.14913 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:29.359231+0000 mon.b (mon.2) 285 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:29.359821+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:29.363085+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T08:58:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:29.392944+0000 mon.b (mon.2) 286 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:29.393598+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:29 smithi145 bash[35820]: audit 2024-02-10T08:58:29.396884+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:58:30.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T08:58:30.559 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:30 smithi040 bash[35794]: cephadm 2024-02-10T08:58:29.358441+0000 mgr.x (mgr.34733) 96 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:30.559 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:30 smithi040 bash[35794]: cephadm 2024-02-10T08:58:29.401794+0000 mgr.x (mgr.34733) 97 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:30.559 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:30 smithi040 bash[35794]: cluster 2024-02-10T08:58:29.470961+0000 mgr.x (mgr.34733) 98 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:30.559 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:30 smithi040 bash[38951]: cephadm 2024-02-10T08:58:29.358441+0000 mgr.x (mgr.34733) 96 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:30.559 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:30 smithi040 bash[38951]: cephadm 2024-02-10T08:58:29.401794+0000 mgr.x (mgr.34733) 97 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:30.559 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:30 smithi040 bash[38951]: cluster 2024-02-10T08:58:29.470961+0000 mgr.x (mgr.34733) 98 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:30 smithi145 bash[35820]: cephadm 2024-02-10T08:58:29.358441+0000 mgr.x (mgr.34733) 96 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:30 smithi145 bash[35820]: cephadm 2024-02-10T08:58:29.401794+0000 mgr.x (mgr.34733) 97 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T08:58:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:30 smithi145 bash[35820]: cluster 2024-02-10T08:58:29.470961+0000 mgr.x (mgr.34733) 98 : cluster [DBG] pgmap v96: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.351333+0000 mon.b (mon.2) 287 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.351792+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.355678+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.357494+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.358627+0000 mon.b (mon.2) 289 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.359053+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.362743+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.369168+0000 mon.b (mon.2) 290 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-10T08:58:31.889 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.369523+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.351333+0000 mon.b (mon.2) 287 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.351792+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.355678+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.357494+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.358627+0000 mon.b (mon.2) 289 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.359053+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.362743+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.369168+0000 mon.b (mon.2) 290 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.369523+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-10T08:58:31.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: cluster 2024-02-10T08:58:31.374034+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.377569+0000 mon.b (mon.2) 291 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.377878+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.378682+0000 mon.b (mon.2) 292 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[35794]: audit 2024-02-10T08:58:31.378979+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: cluster 2024-02-10T08:58:31.374034+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.377569+0000 mon.b (mon.2) 291 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.377878+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.378682+0000 mon.b (mon.2) 292 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:58:31.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:31 smithi040 bash[38951]: audit 2024-02-10T08:58:31.378979+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:58:32.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.351333+0000 mon.b (mon.2) 287 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:32.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.351792+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T08:58:32.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.355678+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mgr\"], \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.357494+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.358627+0000 mon.b (mon.2) 289 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.359053+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.362743+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.369168+0000 mon.b (mon.2) 290 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.369523+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: cluster 2024-02-10T08:58:31.374034+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.377569+0000 mon.b (mon.2) 291 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.377878+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.378682+0000 mon.b (mon.2) 292 : audit [INF] from='mgr.34733 172.21.15.145:0/3858188475' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:58:32.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:31 smithi145 bash[35820]: audit 2024-02-10T08:58:31.378979+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T08:58:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: debug 2024-02-10T08:58:32.366+0000 7f0b814ff700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-10T08:58:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: ignoring --setuser ceph since I am not root 2024-02-10T08:58:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: ignoring --setgroup ceph since I am not root 2024-02-10T08:58:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: debug 2024-02-10T08:58:32.408+0000 7fa2d9732700 1 -- 172.21.15.145:0/666854056 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5632a7a924e0 con 0x5632a7a68c00 2024-02-10T08:58:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: debug 2024-02-10T08:58:32.529+0000 7fa2e9910680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:58:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: debug 2024-02-10T08:58:32.613+0000 7fa2e9910680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cephadm 2024-02-10T08:58:31.356233+0000 mgr.x (mgr.34733) 99 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cephadm 2024-02-10T08:58:31.356380+0000 mgr.x (mgr.34733) 100 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cephadm 2024-02-10T08:58:31.365933+0000 mgr.x (mgr.34733) 101 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cephadm 2024-02-10T08:58:31.366510+0000 mgr.x (mgr.34733) 102 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cephadm 2024-02-10T08:58:31.368856+0000 mgr.x (mgr.34733) 103 : cephadm [INF] Failing over to other MGR 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cluster 2024-02-10T08:58:31.471385+0000 mgr.x (mgr.34733) 104 : cluster [DBG] pgmap v98: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: audit 2024-02-10T08:58:32.366657+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cluster 2024-02-10T08:58:32.366719+0000 mon.a (mon.0) 811 : cluster [DBG] mgrmap e27: y(active, starting, since 0.996696s) 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: audit 2024-02-10T08:58:32.375472+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:58:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[35820]: cluster 2024-02-10T08:58:32.375535+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cephadm 2024-02-10T08:58:31.356233+0000 mgr.x (mgr.34733) 99 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cephadm 2024-02-10T08:58:31.356380+0000 mgr.x (mgr.34733) 100 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cephadm 2024-02-10T08:58:31.365933+0000 mgr.x (mgr.34733) 101 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cephadm 2024-02-10T08:58:31.366510+0000 mgr.x (mgr.34733) 102 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cephadm 2024-02-10T08:58:31.368856+0000 mgr.x (mgr.34733) 103 : cephadm [INF] Failing over to other MGR 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cluster 2024-02-10T08:58:31.471385+0000 mgr.x (mgr.34733) 104 : cluster [DBG] pgmap v98: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: audit 2024-02-10T08:58:32.366657+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cluster 2024-02-10T08:58:32.366719+0000 mon.a (mon.0) 811 : cluster [DBG] mgrmap e27: y(active, starting, since 0.996696s) 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: audit 2024-02-10T08:58:32.375472+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:58:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[35794]: cluster 2024-02-10T08:58:32.375535+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cephadm 2024-02-10T08:58:31.356233+0000 mgr.x (mgr.34733) 99 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cephadm 2024-02-10T08:58:31.356380+0000 mgr.x (mgr.34733) 100 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cephadm 2024-02-10T08:58:31.365933+0000 mgr.x (mgr.34733) 101 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cephadm 2024-02-10T08:58:31.366510+0000 mgr.x (mgr.34733) 102 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cephadm 2024-02-10T08:58:31.368856+0000 mgr.x (mgr.34733) 103 : cephadm [INF] Failing over to other MGR 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cluster 2024-02-10T08:58:31.471385+0000 mgr.x (mgr.34733) 104 : cluster [DBG] pgmap v98: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: audit 2024-02-10T08:58:32.366657+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cluster 2024-02-10T08:58:32.366719+0000 mon.a (mon.0) 811 : cluster [DBG] mgrmap e27: y(active, starting, since 0.996696s) 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: audit 2024-02-10T08:58:32.375472+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34733 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T08:58:32.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:32 smithi040 bash[38951]: cluster 2024-02-10T08:58:32.375535+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T08:58:33.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:32 smithi145 bash[48458]: debug 2024-02-10T08:58:32.972+0000 7fa2e9910680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:58:34.002 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:33 smithi145 bash[48458]: debug 2024-02-10T08:58:33.707+0000 7fa2e9910680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:58:34.002 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:33 smithi145 bash[48458]: debug 2024-02-10T08:58:33.791+0000 7fa2e9910680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:58:34.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:34 smithi145 bash[48458]: debug 2024-02-10T08:58:34.002+0000 7fa2e9910680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:58:35.232 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:34 smithi145 bash[48458]: debug 2024-02-10T08:58:34.934+0000 7fa2e9910680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:58:35.233 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:35 smithi145 bash[48458]: debug 2024-02-10T08:58:35.062+0000 7fa2e9910680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:58:35.233 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:35 smithi145 bash[48458]: debug 2024-02-10T08:58:35.140+0000 7fa2e9910680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:58:35.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:35 smithi145 bash[48458]: debug 2024-02-10T08:58:35.229+0000 7fa2e9910680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:58:35.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:35 smithi145 bash[48458]: debug 2024-02-10T08:58:35.424+0000 7fa2e9910680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:58:36.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:35 smithi145 bash[48458]: debug 2024-02-10T08:58:35.705+0000 7fa2e9910680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:58:36.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:35 smithi145 bash[48458]: debug 2024-02-10T08:58:35.803+0000 7fa2e9910680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:58:36.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:36 smithi145 bash[48458]: debug 2024-02-10T08:58:36.525+0000 7fa2e9910680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:58:36.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:36 smithi145 bash[48458]: debug 2024-02-10T08:58:36.606+0000 7fa2e9910680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:58:36.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:36 smithi145 bash[48458]: debug 2024-02-10T08:58:36.698+0000 7fa2e9910680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:58:37.134 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:36 smithi145 bash[48458]: debug 2024-02-10T08:58:36.874+0000 7fa2e9910680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:58:37.396 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[48458]: debug 2024-02-10T08:58:37.133+0000 7fa2e9910680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:58:37.396 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[48458]: debug 2024-02-10T08:58:37.264+0000 7fa2e9910680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:58:37.651 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[48458]: debug 2024-02-10T08:58:37.396+0000 7fa2e9910680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:58:37.651 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[48458]: debug 2024-02-10T08:58:37.567+0000 7fa2e9910680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:58:38.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[48458]: debug 2024-02-10T08:58:37.650+0000 7fa2e9910680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:58:38.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[35820]: audit 2024-02-10T08:58:37.665101+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:58:38.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[35820]: cluster 2024-02-10T08:58:37.665175+0000 mon.a (mon.0) 814 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:58:38.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[35820]: audit 2024-02-10T08:58:37.665410+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:58:38.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[35820]: audit 2024-02-10T08:58:37.666343+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:58:38.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:37 smithi145 bash[35820]: audit 2024-02-10T08:58:37.666579+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:58:38.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[35794]: audit 2024-02-10T08:58:37.665101+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:58:38.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[35794]: cluster 2024-02-10T08:58:37.665175+0000 mon.a (mon.0) 814 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:58:38.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[35794]: audit 2024-02-10T08:58:37.665410+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:58:38.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[35794]: audit 2024-02-10T08:58:37.666343+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:58:38.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[35794]: audit 2024-02-10T08:58:37.666579+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:58:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[38951]: audit 2024-02-10T08:58:37.665101+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:58:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[38951]: cluster 2024-02-10T08:58:37.665175+0000 mon.a (mon.0) 814 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:58:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[38951]: audit 2024-02-10T08:58:37.665410+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:58:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[38951]: audit 2024-02-10T08:58:37.666343+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:58:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:37 smithi040 bash[38951]: audit 2024-02-10T08:58:37.666579+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.? 172.21.15.145:0/2807432868' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:58:38.764 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T08:58:38.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:58:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: [79B blob data] 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 08:58:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: [80B blob data] 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: cluster 2024-02-10T08:58:37.724808+0000 mon.a (mon.0) 815 : cluster [DBG] mgrmap e28: y(active, starting, since 6s), standbys: x 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:37.725225+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:37.725536+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.368490+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.368732+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.368952+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.371172+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.371488+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.371739+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:58:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.371978+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.372603+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.372948+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.373294+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.373533+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.373983+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.374226+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.374871+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.375840+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: cluster 2024-02-10T08:58:37.724808+0000 mon.a (mon.0) 815 : cluster [DBG] mgrmap e28: y(active, starting, since 6s), standbys: x 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:37.725225+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:58:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:37.725536+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.368490+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.368732+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.368952+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.371172+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.371488+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.371739+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.371978+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.372603+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.372948+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.373294+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.373533+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.373983+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.374226+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.374871+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:58:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.375840+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.376773+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.377174+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.377560+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.377917+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.378368+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.378767+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.379181+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.379559+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.379943+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:58:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.380337+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.380701+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.381051+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.381440+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.381808+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.382177+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.382536+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.382879+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.383243+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.383599+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.383958+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.384321+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.384682+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.385042+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: cluster 2024-02-10T08:58:38.412250+0000 mon.a (mon.0) 818 : cluster [INF] Manager daemon y is now available 2024-02-10T08:58:38.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.523726+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.574518+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.574863+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.578965+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[38951]: audit 2024-02-10T08:58:38.579249+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.376773+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.377174+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.377560+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.377917+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.378368+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:58:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.378767+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.379181+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.379559+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.379943+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.380337+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.380701+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.381051+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.381440+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.381808+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.382177+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.382536+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.382879+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.383243+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.383599+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.383958+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.384321+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:58:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.384682+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.385042+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: cluster 2024-02-10T08:58:38.412250+0000 mon.a (mon.0) 818 : cluster [INF] Manager daemon y is now available 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.523726+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.574518+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.574863+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.578965+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:58:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:38 smithi040 bash[35794]: audit 2024-02-10T08:58:38.579249+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:58:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: cluster 2024-02-10T08:58:37.724808+0000 mon.a (mon.0) 815 : cluster [DBG] mgrmap e28: y(active, starting, since 6s), standbys: x 2024-02-10T08:58:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:37.725225+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:37.725536+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.? 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.368490+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.368732+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.368952+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.371172+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.371488+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.371739+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.371978+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.372603+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.372948+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.373294+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.373533+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.373983+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.374226+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.374871+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.375840+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T08:58:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.376773+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.377174+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.377560+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.377917+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.378368+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.378767+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.379181+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.379559+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.379943+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.380337+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.380701+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.381051+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.381440+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.381808+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.382177+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.382536+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T08:58:39.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.382879+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.383243+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.383599+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.383958+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.384321+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.384682+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.385042+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: cluster 2024-02-10T08:58:38.412250+0000 mon.a (mon.0) 818 : cluster [INF] Manager daemon y is now available 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.523726+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.574518+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.574863+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.578965+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:58:39.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:38 smithi145 bash[35820]: audit 2024-02-10T08:58:38.579249+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T08:58:39.451 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:58:39.451 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (12m) 3m ago 22m 17.3M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:58:39.451 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (21m) 3m ago 21m 35.0M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:58:39.451 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 running (16m) 3m ago 25m 405M - 16.2.14-521-g0e714d9a 1fbc92c859dc b9b23ff414a1 2024-02-10T08:58:39.451 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (9m) 3m ago 27m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (27m) 3m ago 27m 175M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (26m) 3m ago 26m 150M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (26m) 3m ago 26m 149M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (22m) 3m ago 22m 13.5M - 1.7.0 72c9c2088986 499f0f53e04a 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (22m) 3m ago 22m 13.9M - 1.7.0 72c9c2088986 b3a2408fef6b 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (25m) 3m ago 25m 47.4M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (25m) 3m ago 25m 44.8M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (24m) 3m ago 24m 45.3M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (24m) 3m ago 24m 48.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (24m) 3m ago 24m 47.1M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (23m) 3m ago 23m 45.2M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (23m) 3m ago 23m 44.6M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:58:39.452 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (23m) 3m ago 23m 44.8M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:58:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (12m) 3m ago 22m 52.9M - 2.49.1 2a72b385beaf 37cd9848751b 2024-02-10T08:58:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (20m) 3m ago 20m 36.6M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:58:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (20m) 3m ago 20m 37.2M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:58:39.850 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:58:39.851 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T08:58:39.852 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:58:39.852 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:58:39.852 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:38.743224+0000 mgr.y (mgr.14883) 1 : audit [DBG] from='client.14925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: cluster 2024-02-10T08:58:38.743927+0000 mon.a (mon.0) 821 : cluster [DBG] mgrmap e29: y(active, since 7s), standbys: x 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:38.749105+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: cluster 2024-02-10T08:58:38.751715+0000 mgr.y (mgr.14883) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:38.754258+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.107797+0000 mgr.y (mgr.14883) 3 : audit [DBG] from='client.24847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.438266+0000 mgr.y (mgr.14883) 4 : audit [DBG] from='client.14949 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.440449+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.441059+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.441417+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.441735+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.442075+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.442398+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.444017+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.444355+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.444699+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.445024+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:39 smithi145 bash[35820]: audit 2024-02-10T08:58:39.445362+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:38.743224+0000 mgr.y (mgr.14883) 1 : audit [DBG] from='client.14925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: cluster 2024-02-10T08:58:38.743927+0000 mon.a (mon.0) 821 : cluster [DBG] mgrmap e29: y(active, since 7s), standbys: x 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:38.749105+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: cluster 2024-02-10T08:58:38.751715+0000 mgr.y (mgr.14883) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:38.754258+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.107797+0000 mgr.y (mgr.14883) 3 : audit [DBG] from='client.24847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.438266+0000 mgr.y (mgr.14883) 4 : audit [DBG] from='client.14949 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.440449+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.441059+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.441417+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.441735+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.442075+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.442398+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.444017+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.444355+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.444699+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.445024+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[35794]: audit 2024-02-10T08:58:39.445362+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:38.743224+0000 mgr.y (mgr.14883) 1 : audit [DBG] from='client.14925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: cluster 2024-02-10T08:58:38.743927+0000 mon.a (mon.0) 821 : cluster [DBG] mgrmap e29: y(active, since 7s), standbys: x 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:38.749105+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: cluster 2024-02-10T08:58:38.751715+0000 mgr.y (mgr.14883) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:38.754258+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.107797+0000 mgr.y (mgr.14883) 3 : audit [DBG] from='client.24847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.438266+0000 mgr.y (mgr.14883) 4 : audit [DBG] from='client.14949 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:40.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.440449+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.441059+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.441417+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.441735+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.442075+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.442398+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.444017+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.444355+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.444699+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.445024+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:39 smithi040 bash[38951]: audit 2024-02-10T08:58:39.445362+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [ 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr" 2024-02-10T08:58:40.193 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:58:40.194 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "2/2 daemons upgraded", 2024-02-10T08:58:40.194 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "", 2024-02-10T08:58:40.194 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T08:58:40.194 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:58:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:40 smithi145 bash[35820]: audit 2024-02-10T08:58:39.850461+0000 mon.a (mon.0) 822 : audit [DBG] from='client.? 172.21.15.40:0/4017748669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:58:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:40 smithi145 bash[35820]: audit 2024-02-10T08:58:40.193477+0000 mgr.y (mgr.14883) 5 : audit [DBG] from='client.24865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:40 smithi145 bash[35820]: cluster 2024-02-10T08:58:40.373961+0000 mgr.y (mgr.14883) 6 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:41.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:40 smithi040 bash[35794]: audit 2024-02-10T08:58:39.850461+0000 mon.a (mon.0) 822 : audit [DBG] from='client.? 172.21.15.40:0/4017748669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:58:41.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:40 smithi040 bash[35794]: audit 2024-02-10T08:58:40.193477+0000 mgr.y (mgr.14883) 5 : audit [DBG] from='client.24865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:41.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:40 smithi040 bash[35794]: cluster 2024-02-10T08:58:40.373961+0000 mgr.y (mgr.14883) 6 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:40 smithi040 bash[38951]: audit 2024-02-10T08:58:39.850461+0000 mon.a (mon.0) 822 : audit [DBG] from='client.? 172.21.15.40:0/4017748669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:58:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:40 smithi040 bash[38951]: audit 2024-02-10T08:58:40.193477+0000 mgr.y (mgr.14883) 5 : audit [DBG] from='client.24865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:58:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:40 smithi040 bash[38951]: cluster 2024-02-10T08:58:40.373961+0000 mgr.y (mgr.14883) 6 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:42.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:41 smithi145 bash[35820]: cluster 2024-02-10T08:58:40.759377+0000 mon.a (mon.0) 823 : cluster [DBG] mgrmap e30: y(active, since 9s), standbys: x 2024-02-10T08:58:42.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:41 smithi040 bash[35794]: cluster 2024-02-10T08:58:40.759377+0000 mon.a (mon.0) 823 : cluster [DBG] mgrmap e30: y(active, since 9s), standbys: x 2024-02-10T08:58:42.089 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:41 smithi040 bash[38951]: cluster 2024-02-10T08:58:40.759377+0000 mon.a (mon.0) 823 : cluster [DBG] mgrmap e30: y(active, since 9s), standbys: x 2024-02-10T08:58:42.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:42 smithi040 bash[35794]: cluster 2024-02-10T08:58:42.374281+0000 mgr.y (mgr.14883) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:42.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:42 smithi040 bash[38951]: cluster 2024-02-10T08:58:42.374281+0000 mgr.y (mgr.14883) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:42 smithi145 bash[35820]: cluster 2024-02-10T08:58:42.374281+0000 mgr.y (mgr.14883) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:44.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.335415+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:44.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.335934+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:44.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.339089+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:58:44.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.634366+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.634756+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.635055+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.635397+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.635720+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.636056+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.636366+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.636646+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:43 smithi145 bash[35820]: audit 2024-02-10T08:58:43.636932+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.335415+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:44.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.335415+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:44.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.335934+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:44.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.339089+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:58:44.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.634366+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.634756+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.635055+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.635397+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.635720+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.636056+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.636366+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.636646+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[35794]: audit 2024-02-10T08:58:43.636932+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.335934+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.339089+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"499f0f53e04a\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14470348, \"cpu_percentage\": \"0.29%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333909Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:36:15.890238Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:03.421811Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:43.334174Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.634366+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.634756+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.635055+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.635397+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.635720+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.636056+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.636366+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.636646+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:44.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:43 smithi040 bash[38951]: audit 2024-02-10T08:58:43.636932+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: cluster 2024-02-10T08:58:44.374922+0000 mgr.y (mgr.14883) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.436007+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.436645+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.440580+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.719204+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.719736+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.720172+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.720614+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.721052+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.721497+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.721922+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.722358+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.722869+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.724635+0000 mon.c (mon.1) 216 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.724990+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.728758+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.735480+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.736678+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:45.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:44 smithi145 bash[35820]: audit 2024-02-10T08:58:44.737002+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: cluster 2024-02-10T08:58:44.374922+0000 mgr.y (mgr.14883) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: cluster 2024-02-10T08:58:44.374922+0000 mgr.y (mgr.14883) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:45.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.436007+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:45.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.436007+0000 mon.c (mon.1) 206 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:45.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.436645+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.436645+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:58:45.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.440580+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.719204+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.719736+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.720172+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.720614+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.721052+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.721497+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.721922+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.722358+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.722869+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.724635+0000 mon.c (mon.1) 216 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.724990+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.440580+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"b9b23ff414a1\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 399717171, \"cpu_percentage\": \"3.13%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433674Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:42:05.865471Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:41:28.032308Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:58:44.434506Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.719204+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.719736+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.720172+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.720614+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.721052+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.721497+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.721922+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.722358+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.722869+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.724635+0000 mon.c (mon.1) 216 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:45.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.724990+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.728758+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.735480+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.736678+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[38951]: audit 2024-02-10T08:58:44.737002+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.728758+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.735480+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.736678+0000 mon.c (mon.1) 218 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:45.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:44 smithi040 bash[35794]: audit 2024-02-10T08:58:44.737002+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:58:46.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[35794]: audit 2024-02-10T08:58:46.356977+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[35794]: audit 2024-02-10T08:58:46.357309+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[35794]: audit 2024-02-10T08:58:46.358395+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[35794]: audit 2024-02-10T08:58:46.359398+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[35794]: audit 2024-02-10T08:58:46.360663+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[38951]: audit 2024-02-10T08:58:46.356977+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[38951]: audit 2024-02-10T08:58:46.357309+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[38951]: audit 2024-02-10T08:58:46.358395+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[38951]: audit 2024-02-10T08:58:46.359398+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:58:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:46 smithi040 bash[38951]: audit 2024-02-10T08:58:46.360663+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-10T08:58:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:46 smithi145 bash[35820]: audit 2024-02-10T08:58:46.356977+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:58:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:46 smithi145 bash[35820]: audit 2024-02-10T08:58:46.357309+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T08:58:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:46 smithi145 bash[35820]: audit 2024-02-10T08:58:46.358395+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T08:58:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:46 smithi145 bash[35820]: audit 2024-02-10T08:58:46.359398+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T08:58:46.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:46 smithi145 bash[35820]: audit 2024-02-10T08:58:46.360663+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-10T08:58:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:47 smithi145 bash[35820]: cephadm 2024-02-10T08:58:46.356563+0000 mgr.y (mgr.14883) 9 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-10T08:58:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:47 smithi145 bash[35820]: cephadm 2024-02-10T08:58:46.360188+0000 mgr.y (mgr.14883) 10 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:58:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:47 smithi145 bash[35820]: cluster 2024-02-10T08:58:46.375372+0000 mgr.y (mgr.14883) 11 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:47.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:47 smithi040 bash[35794]: cephadm 2024-02-10T08:58:46.356563+0000 mgr.y (mgr.14883) 9 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-10T08:58:47.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:47 smithi040 bash[35794]: cephadm 2024-02-10T08:58:46.360188+0000 mgr.y (mgr.14883) 10 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:58:47.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:47 smithi040 bash[35794]: cluster 2024-02-10T08:58:46.375372+0000 mgr.y (mgr.14883) 11 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:47.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:47 smithi040 bash[38951]: cephadm 2024-02-10T08:58:46.356563+0000 mgr.y (mgr.14883) 9 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-10T08:58:47.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:47 smithi040 bash[38951]: cephadm 2024-02-10T08:58:46.360188+0000 mgr.y (mgr.14883) 10 : cephadm [INF] Deploying daemon mgr.x on smithi145 2024-02-10T08:58:47.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:47 smithi040 bash[38951]: cluster 2024-02-10T08:58:46.375372+0000 mgr.y (mgr.14883) 11 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:48.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:47 smithi145 systemd[1]: Stopping Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:58:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:49 smithi145 bash[35820]: cluster 2024-02-10T08:58:48.375802+0000 mgr.y (mgr.14883) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:49.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:49 smithi040 bash[35794]: cluster 2024-02-10T08:58:48.375802+0000 mgr.y (mgr.14883) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:49.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:49 smithi040 bash[38951]: cluster 2024-02-10T08:58:48.375802+0000 mgr.y (mgr.14883) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:51 smithi145 bash[35820]: cluster 2024-02-10T08:58:50.376478+0000 mgr.y (mgr.14883) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:51.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:51 smithi040 bash[35794]: cluster 2024-02-10T08:58:50.376478+0000 mgr.y (mgr.14883) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:51.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:51 smithi040 bash[38951]: cluster 2024-02-10T08:58:50.376478+0000 mgr.y (mgr.14883) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:53 smithi145 bash[35820]: cluster 2024-02-10T08:58:52.376852+0000 mgr.y (mgr.14883) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:53.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:53 smithi040 bash[35794]: cluster 2024-02-10T08:58:52.376852+0000 mgr.y (mgr.14883) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:53 smithi040 bash[38951]: cluster 2024-02-10T08:58:52.376852+0000 mgr.y (mgr.14883) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:55 smithi145 bash[35820]: cluster 2024-02-10T08:58:54.377478+0000 mgr.y (mgr.14883) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:55.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:55 smithi040 bash[35794]: cluster 2024-02-10T08:58:54.377478+0000 mgr.y (mgr.14883) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:55 smithi040 bash[38951]: cluster 2024-02-10T08:58:54.377478+0000 mgr.y (mgr.14883) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:57 smithi145 bash[35820]: cluster 2024-02-10T08:58:56.377865+0000 mgr.y (mgr.14883) 16 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:57.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:57 smithi040 bash[35794]: cluster 2024-02-10T08:58:56.377865+0000 mgr.y (mgr.14883) 16 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:57.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:57 smithi040 bash[38951]: cluster 2024-02-10T08:58:56.377865+0000 mgr.y (mgr.14883) 16 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:58.482 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:58 smithi145 bash[55691]: time="2024-02-10T08:58:58Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x in 10 seconds, resorting to SIGKILL" 2024-02-10T08:58:58.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:58 smithi145 bash[55691]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x 2024-02-10T08:58:59.205 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:58 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-10T08:58:59.464 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:59 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-10T08:58:59.464 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:59 smithi145 systemd[1]: Stopped Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:58:59.464 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:59 smithi145 systemd[1]: Starting Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:58:59.726 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:58:59 smithi145 bash[35820]: cluster 2024-02-10T08:58:58.378263+0000 mgr.y (mgr.14883) 17 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:59.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:58:59 smithi040 bash[35794]: cluster 2024-02-10T08:58:58.378263+0000 mgr.y (mgr.14883) 17 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:58:59.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:58:59 smithi040 bash[38951]: cluster 2024-02-10T08:58:58.378263+0000 mgr.y (mgr.14883) 17 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:00.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:58:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:58:59.942+0000 7f3d41f6a700 1 -- 172.21.15.145:0/551649889 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ac43d924e0 con 0x55ac43d67400 2024-02-10T08:59:00.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:00 smithi145 bash[55884]: 80326d960b75a709745461309c86d6b8de91fc202d3886f5a23a5d122337b822 2024-02-10T08:59:00.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:00 smithi145 systemd[1]: Started Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:00.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:00.069+0000 7f3d52566680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T08:59:00.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:00.155+0000 7f3d52566680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T08:59:00.755 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:00.567+0000 7f3d52566680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T08:59:00.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:00 smithi145 bash[35820]: audit 2024-02-10T08:59:00.082471+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:00.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:00 smithi145 bash[35820]: audit 2024-02-10T08:59:00.083101+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:00.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:00 smithi145 bash[35820]: audit 2024-02-10T08:59:00.087935+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:00.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:00 smithi145 bash[35820]: audit 2024-02-10T08:59:00.089674+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:00.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[35794]: audit 2024-02-10T08:59:00.082471+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:00.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[38951]: audit 2024-02-10T08:59:00.082471+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:00.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[35794]: audit 2024-02-10T08:59:00.083101+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:00.829 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[35794]: audit 2024-02-10T08:59:00.087935+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:00.829 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[35794]: audit 2024-02-10T08:59:00.089674+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:00.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[38951]: audit 2024-02-10T08:59:00.083101+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:00.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[38951]: audit 2024-02-10T08:59:00.087935+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 186751385, \"cpu_percentage\": \"0.88%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433490Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433766Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433850Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.433930Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48622469, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434009Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.28%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434113Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13589544, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434197Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36909875, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:44.434275Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40317747, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:44.434352Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:00.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:00 smithi040 bash[38951]: audit 2024-02-10T08:59:00.089674+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:01.644 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:01 smithi145 bash[35820]: cluster 2024-02-10T08:59:00.379040+0000 mgr.y (mgr.14883) 18 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:01.644 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:01.341+0000 7f3d52566680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T08:59:01.644 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:01.432+0000 7f3d52566680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T08:59:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:01 smithi040 bash[35794]: cluster 2024-02-10T08:59:00.379040+0000 mgr.y (mgr.14883) 18 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:01.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:01 smithi040 bash[38951]: cluster 2024-02-10T08:59:00.379040+0000 mgr.y (mgr.14883) 18 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:02.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:01.643+0000 7f3d52566680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T08:59:03.015 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:02.661+0000 7f3d52566680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T08:59:03.015 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:02.818+0000 7f3d52566680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:59:03.015 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:02.907+0000 7f3d52566680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T08:59:03.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:03.014+0000 7f3d52566680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T08:59:03.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:03.240+0000 7f3d52566680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T08:59:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:03 smithi145 bash[35820]: cluster 2024-02-10T08:59:02.379522+0000 mgr.y (mgr.14883) 19 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:03.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:03.529+0000 7f3d52566680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T08:59:03.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:03.633+0000 7f3d52566680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T08:59:03.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:03 smithi040 bash[35794]: cluster 2024-02-10T08:59:02.379522+0000 mgr.y (mgr.14883) 19 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:03.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:03 smithi040 bash[38951]: cluster 2024-02-10T08:59:02.379522+0000 mgr.y (mgr.14883) 19 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:04.748 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:04.388+0000 7f3d52566680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T08:59:04.748 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:04.471+0000 7f3d52566680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T08:59:04.748 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:04.570+0000 7f3d52566680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T08:59:05.012 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:04.747+0000 7f3d52566680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T08:59:05.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:05.011+0000 7f3d52566680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T08:59:05.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:05.152+0000 7f3d52566680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T08:59:05.563 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:05 smithi145 bash[35820]: cluster 2024-02-10T08:59:04.380190+0000 mgr.y (mgr.14883) 20 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:05.563 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:05.298+0000 7f3d52566680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T08:59:05.564 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:05.469+0000 7f3d52566680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T08:59:05.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:05 smithi040 bash[35794]: cluster 2024-02-10T08:59:04.380190+0000 mgr.y (mgr.14883) 20 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:05.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:05 smithi040 bash[38951]: cluster 2024-02-10T08:59:04.380190+0000 mgr.y (mgr.14883) 20 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:06.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 08:59:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T08:59:05.561+0000 7f3d52566680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T08:59:06.729 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: cluster 2024-02-10T08:59:05.577237+0000 mon.a (mon.0) 834 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:59:06.729 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: cluster 2024-02-10T08:59:05.577378+0000 mon.a (mon.0) 835 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:59:06.729 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:05.577995+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:05.578376+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:05.579352+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:05.579592+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.211595+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.212273+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.216078+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.218580+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.218927+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.221944+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.228258+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:06.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.229354+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.229651+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.231196+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: cluster 2024-02-10T08:59:05.577237+0000 mon.a (mon.0) 834 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: cluster 2024-02-10T08:59:05.577378+0000 mon.a (mon.0) 835 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:05.577995+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:05.578376+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:05.579352+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:59:06.731 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:05.579592+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.232031+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.232298+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.236271+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.238236+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.239245+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.239533+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.243527+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]': finished 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.245804+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.246764+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.247040+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.250937+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]': finished 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.252785+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.732 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.253677+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.253980+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T08:59:06.733 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.211595+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.257708+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]': finished 2024-02-10T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.259421+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.260337+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.733 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.260635+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.265523+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]': finished 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.266926+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.267813+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.268092+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.273162+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]': finished 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.274500+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.275355+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.275635+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T08:59:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[35794]: audit 2024-02-10T08:59:06.279566+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]': finished 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.212273+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.216078+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.218580+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.218927+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.221944+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.228258+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.229354+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.229651+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.231196+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.735 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.232031+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.232298+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.236271+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.238236+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.239245+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.239533+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.243527+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]': finished 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.245804+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.246764+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.247040+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.250937+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]': finished 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.252785+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.253677+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.253980+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T08:59:06.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.257708+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]': finished 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.259421+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.260337+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.260635+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.265523+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]': finished 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.266926+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.267813+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.268092+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.273162+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]': finished 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.274500+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.275355+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.275635+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T08:59:06.737 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:06 smithi040 bash[38951]: audit 2024-02-10T08:59:06.279566+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]': finished 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: cluster 2024-02-10T08:59:05.577237+0000 mon.a (mon.0) 834 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: cluster 2024-02-10T08:59:05.577378+0000 mon.a (mon.0) 835 : cluster [DBG] Standby manager daemon x started 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:05.577995+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:05.578376+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:05.579352+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:05.579592+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.? 172.21.15.145:0/3447760671' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T08:59:06.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.211595+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.212273+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.216078+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"b3a2408fef6b\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14218690, \"cpu_percentage\": \"0.27%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209871Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:36:12.247921Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:36:02.922460Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:06.210198Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.218580+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.218927+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.221944+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.228258+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.229354+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.229651+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.231196+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.232031+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.232298+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.236271+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-10T08:59:06.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.238236+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.239245+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.239533+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.243527+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]': finished 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.245804+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.246764+0000 mon.c (mon.1) 234 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.247040+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.250937+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]': finished 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.252785+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.253677+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.253980+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.257708+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]': finished 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.259421+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.260337+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.260635+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.265523+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]': finished 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.266926+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.267813+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.268092+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.273162+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]': finished 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.274500+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.275355+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.275635+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T08:59:06.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:06 smithi145 bash[35820]: audit 2024-02-10T08:59:06.279566+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]': finished 2024-02-10T08:59:07.624 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cephadm 2024-02-10T08:59:06.238973+0000 mgr.y (mgr.14883) 21 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T08:59:07.624 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cephadm 2024-02-10T08:59:06.246525+0000 mgr.y (mgr.14883) 22 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cephadm 2024-02-10T08:59:06.253457+0000 mgr.y (mgr.14883) 23 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cephadm 2024-02-10T08:59:06.260118+0000 mgr.y (mgr.14883) 24 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cephadm 2024-02-10T08:59:06.267594+0000 mgr.y (mgr.14883) 25 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cephadm 2024-02-10T08:59:06.275148+0000 mgr.y (mgr.14883) 26 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cluster 2024-02-10T08:59:06.380530+0000 mgr.y (mgr.14883) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[38951]: cluster 2024-02-10T08:59:06.494650+0000 mon.a (mon.0) 855 : cluster [DBG] mgrmap e31: y(active, since 35s), standbys: x 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cephadm 2024-02-10T08:59:06.238973+0000 mgr.y (mgr.14883) 21 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cephadm 2024-02-10T08:59:06.246525+0000 mgr.y (mgr.14883) 22 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cephadm 2024-02-10T08:59:06.253457+0000 mgr.y (mgr.14883) 23 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cephadm 2024-02-10T08:59:06.260118+0000 mgr.y (mgr.14883) 24 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cephadm 2024-02-10T08:59:06.267594+0000 mgr.y (mgr.14883) 25 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T08:59:07.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cephadm 2024-02-10T08:59:06.275148+0000 mgr.y (mgr.14883) 26 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T08:59:07.626 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cluster 2024-02-10T08:59:06.380530+0000 mgr.y (mgr.14883) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:07.626 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:07 smithi040 bash[35794]: cluster 2024-02-10T08:59:06.494650+0000 mon.a (mon.0) 855 : cluster [DBG] mgrmap e31: y(active, since 35s), standbys: x 2024-02-10T08:59:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cephadm 2024-02-10T08:59:06.238973+0000 mgr.y (mgr.14883) 21 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T08:59:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cephadm 2024-02-10T08:59:06.246525+0000 mgr.y (mgr.14883) 22 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T08:59:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cephadm 2024-02-10T08:59:06.253457+0000 mgr.y (mgr.14883) 23 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T08:59:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cephadm 2024-02-10T08:59:06.260118+0000 mgr.y (mgr.14883) 24 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T08:59:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cephadm 2024-02-10T08:59:06.267594+0000 mgr.y (mgr.14883) 25 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T08:59:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cephadm 2024-02-10T08:59:06.275148+0000 mgr.y (mgr.14883) 26 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cluster 2024-02-10T08:59:06.380530+0000 mgr.y (mgr.14883) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:07 smithi145 bash[35820]: cluster 2024-02-10T08:59:06.494650+0000 mon.a (mon.0) 855 : cluster [DBG] mgrmap e31: y(active, since 35s), standbys: x 2024-02-10T08:59:08.381 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:08 smithi040 systemd[1]: Stopping Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[35794]: cephadm 2024-02-10T08:59:07.644749+0000 mgr.y (mgr.14883) 28 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-02-10T08:59:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[35794]: cephadm 2024-02-10T08:59:07.644905+0000 mgr.y (mgr.14883) 29 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-10T08:59:08.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[35794]: cluster 2024-02-10T08:59:08.380896+0000 mgr.y (mgr.14883) 30 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:08.675 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[68551]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter.a 2024-02-10T08:59:08.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[38951]: cephadm 2024-02-10T08:59:07.644749+0000 mgr.y (mgr.14883) 28 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-02-10T08:59:08.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[38951]: cephadm 2024-02-10T08:59:07.644905+0000 mgr.y (mgr.14883) 29 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-10T08:59:08.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:08 smithi040 bash[38951]: cluster 2024-02-10T08:59:08.380896+0000 mgr.y (mgr.14883) 30 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:08 smithi145 bash[35820]: cephadm 2024-02-10T08:59:07.644749+0000 mgr.y (mgr.14883) 28 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-02-10T08:59:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:08 smithi145 bash[35820]: cephadm 2024-02-10T08:59:07.644905+0000 mgr.y (mgr.14883) 29 : cephadm [INF] Deploying daemon node-exporter.a on smithi040 2024-02-10T08:59:08.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:08 smithi145 bash[35820]: cluster 2024-02-10T08:59:08.380896+0000 mgr.y (mgr.14883) 30 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:08.925 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:08 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-10T08:59:09.425 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-10T08:59:09.426 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 systemd[1]: Stopped Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:09.426 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 systemd[1]: Starting Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:09.883 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 bash[68736]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-10T08:59:10.175 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 bash[68736]: Getting image source signatures 2024-02-10T08:59:10.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 bash[68736]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-10T08:59:10.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 bash[68736]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-10T08:59:10.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:09 smithi040 bash[68736]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-10T08:59:10.570 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (13m) 27s ago 22m 26.0M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (22m) 5s ago 22m 35.3M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (11s) 5s ago 26m 46.8M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (9m) 27s ago 28m 409M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (28m) 27s ago 28m 203M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (26m) 5s ago 26m 180M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (26m) 27s ago 26m 178M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (22m) 27s ago 23m 13.7M - 1.7.0 72c9c2088986 499f0f53e04a 2024-02-10T08:59:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (22m) 5s ago 23m 13.5M - 1.7.0 72c9c2088986 b3a2408fef6b 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (25m) 27s ago 25m 48.8M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (25m) 27s ago 25m 46.1M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (25m) 27s ago 25m 45.2M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (24m) 27s ago 24m 50.3M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (24m) 5s ago 24m 49.2M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (24m) 5s ago 24m 45.3M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (23m) 5s ago 23m 45.3M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (23m) 5s ago 23m 46.4M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (12m) 5s ago 23m 53.0M - 2.49.1 2a72b385beaf 37cd9848751b 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (21m) 27s ago 21m 39.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:59:11.223 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (21m) 5s ago 21m 38.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:59:11.425 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:10 smithi040 bash[68736]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-10T08:59:11.425 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[68736]: Writing manifest to image destination 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:59:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:59:11.623 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:59:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: cluster 2024-02-10T08:59:10.381468+0000 mgr.y (mgr.14883) 31 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.212769+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.213150+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.213472+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.213784+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.214099+0000 mon.c (mon.1) 247 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.214416+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.216035+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.216345+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.216664+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.216969+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:11 smithi145 bash[35820]: audit 2024-02-10T08:59:11.217260+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.810 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: cluster 2024-02-10T08:59:10.381468+0000 mgr.y (mgr.14883) 31 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:11.810 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.212769+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.810 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.213150+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.213472+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.213784+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.214099+0000 mon.c (mon.1) 247 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.214416+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.216035+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.216345+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.216664+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.216969+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[35794]: audit 2024-02-10T08:59:11.217260+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.811 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.809Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-10T08:59:11.811 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.809Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-10T08:59:11.812 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.810Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-10T08:59:11.812 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.810Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: cluster 2024-02-10T08:59:10.381468+0000 mgr.y (mgr.14883) 31 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.212769+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.213150+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.213472+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.213784+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.214099+0000 mon.c (mon.1) 247 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.214416+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.216035+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.216345+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.216664+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.216969+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.813 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[38951]: audit 2024-02-10T08:59:11.217260+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [ 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr" 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "2/2 daemons upgraded", 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-10T08:59:11.953 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T08:59:11.954 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:59:12.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-10T08:59:12.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=arp 2024-02-10T08:59:12.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-10T08:59:12.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-10T08:59:12.176 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=edac 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-10T08:59:12.177 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=os 2024-02-10T08:59:12.178 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=stat 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=time 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=uname 2024-02-10T08:59:12.179 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-10T08:59:12.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-10T08:59:12.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-10T08:59:12.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-10T08:59:12.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a[68863]: ts=2024-02-10T08:59:11.811Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-10T08:59:12.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 bash[68736]: 55e529403579832e0a464e682de55ccdaf16199ab2c57cfc62924aebb7908b39 2024-02-10T08:59:12.180 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 08:59:11 smithi040 systemd[1]: Started Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:10.557611+0000 mgr.y (mgr.14883) 32 : audit [DBG] from='client.24871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:10.896794+0000 mgr.y (mgr.14883) 33 : audit [DBG] from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:11.210901+0000 mgr.y (mgr.14883) 34 : audit [DBG] from='client.24883 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:11.622032+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? 172.21.15.40:0/1267576026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:11.965469+0000 mon.c (mon.1) 254 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:11.965977+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:12.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:12 smithi145 bash[35820]: audit 2024-02-10T08:59:11.969149+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:12.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:10.557611+0000 mgr.y (mgr.14883) 32 : audit [DBG] from='client.24871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:10.896794+0000 mgr.y (mgr.14883) 33 : audit [DBG] from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:11.210901+0000 mgr.y (mgr.14883) 34 : audit [DBG] from='client.24883 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:11.622032+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? 172.21.15.40:0/1267576026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:12.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:10.557611+0000 mgr.y (mgr.14883) 32 : audit [DBG] from='client.24871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:10.896794+0000 mgr.y (mgr.14883) 33 : audit [DBG] from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:11.210901+0000 mgr.y (mgr.14883) 34 : audit [DBG] from='client.24883 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:12.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:11.622032+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? 172.21.15.40:0/1267576026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:12.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:11.965469+0000 mon.c (mon.1) 254 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:12.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:11.965469+0000 mon.c (mon.1) 254 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:12.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:11.965977+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:12.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[35794]: audit 2024-02-10T08:59:11.969149+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:12.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:11.965977+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:12.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:12 smithi040 bash[38951]: audit 2024-02-10T08:59:11.969149+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 213804646, \"cpu_percentage\": \"1.41%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333371Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 428867584, \"cpu_percentage\": \"3.47%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:58:43.333515Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 187065958, \"cpu_percentage\": \"0.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333589Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51264880, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333656Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333721Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47395635, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333784Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52827258, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.333847Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:58:43.333971Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40894464, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:58:43.334033Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:13.696 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:13 smithi145 bash[35820]: audit 2024-02-10T08:59:11.952399+0000 mgr.y (mgr.14883) 35 : audit [DBG] from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:13.696 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:13 smithi145 bash[35820]: cluster 2024-02-10T08:59:12.381926+0000 mgr.y (mgr.14883) 36 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:13.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:13 smithi040 bash[35794]: audit 2024-02-10T08:59:11.952399+0000 mgr.y (mgr.14883) 35 : audit [DBG] from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:13.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:13 smithi040 bash[35794]: cluster 2024-02-10T08:59:12.381926+0000 mgr.y (mgr.14883) 36 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:13.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:13 smithi040 bash[38951]: audit 2024-02-10T08:59:11.952399+0000 mgr.y (mgr.14883) 35 : audit [DBG] from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:13.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:13 smithi040 bash[38951]: cluster 2024-02-10T08:59:12.381926+0000 mgr.y (mgr.14883) 36 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:14.029 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:13 smithi145 systemd[1]: Stopping Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:14.695 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:14 smithi145 bash[56831]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter.b 2024-02-10T08:59:15.032 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:14 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-10T08:59:15.417 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-10T08:59:15.417 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 systemd[1]: Stopped Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:15.417 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 systemd[1]: Starting Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:15.782 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[57015]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-10T08:59:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[35820]: cephadm 2024-02-10T08:59:13.495395+0000 mgr.y (mgr.14883) 37 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-02-10T08:59:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[35820]: cephadm 2024-02-10T08:59:13.495583+0000 mgr.y (mgr.14883) 38 : cephadm [INF] Deploying daemon node-exporter.b on smithi145 2024-02-10T08:59:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[35820]: cluster 2024-02-10T08:59:14.382785+0000 mgr.y (mgr.14883) 39 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:15.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:15 smithi040 bash[35794]: cephadm 2024-02-10T08:59:13.495395+0000 mgr.y (mgr.14883) 37 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-02-10T08:59:15.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:15 smithi040 bash[35794]: cephadm 2024-02-10T08:59:13.495583+0000 mgr.y (mgr.14883) 38 : cephadm [INF] Deploying daemon node-exporter.b on smithi145 2024-02-10T08:59:15.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:15 smithi040 bash[35794]: cluster 2024-02-10T08:59:14.382785+0000 mgr.y (mgr.14883) 39 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:15.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:15 smithi040 bash[38951]: cephadm 2024-02-10T08:59:13.495395+0000 mgr.y (mgr.14883) 37 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-02-10T08:59:15.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:15 smithi040 bash[38951]: cephadm 2024-02-10T08:59:13.495583+0000 mgr.y (mgr.14883) 38 : cephadm [INF] Deploying daemon node-exporter.b on smithi145 2024-02-10T08:59:15.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:15 smithi040 bash[38951]: cluster 2024-02-10T08:59:14.382785+0000 mgr.y (mgr.14883) 39 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:16.282 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[57015]: Getting image source signatures 2024-02-10T08:59:16.282 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[57015]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-10T08:59:16.282 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[57015]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-10T08:59:16.282 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:15 smithi145 bash[57015]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-10T08:59:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:17 smithi145 bash[35820]: cluster 2024-02-10T08:59:16.383344+0000 mgr.y (mgr.14883) 40 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:17.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:17 smithi040 bash[35794]: cluster 2024-02-10T08:59:16.383344+0000 mgr.y (mgr.14883) 40 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:17.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:17 smithi040 bash[38951]: cluster 2024-02-10T08:59:16.383344+0000 mgr.y (mgr.14883) 40 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:18.782 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:18 smithi145 bash[57015]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-10T08:59:18.782 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:18 smithi145 bash[57015]: Writing manifest to image destination 2024-02-10T08:59:19.454 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.190Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-10T08:59:19.454 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.190Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.190Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.190Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=arp 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=edac 2024-02-10T08:59:19.455 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-10T08:59:19.456 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=os 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=stat 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=time 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-10T08:59:19.457 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=uname 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b[57066]: ts=2024-02-10T08:59:19.191Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[57015]: 3bf2c54c82c953ed07acf9088f014643b5891663766fdc87bffd3bc13f5c687e 2024-02-10T08:59:19.458 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 08:59:19 smithi145 systemd[1]: Started Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:19.728 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[38951]: cluster 2024-02-10T08:59:18.383851+0000 mgr.y (mgr.14883) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:19.728 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[35794]: cluster 2024-02-10T08:59:18.383851+0000 mgr.y (mgr.14883) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:19.729 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[38951]: audit 2024-02-10T08:59:19.345797+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:19.729 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[35794]: audit 2024-02-10T08:59:19.345797+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[38951]: audit 2024-02-10T08:59:19.346466+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[38951]: audit 2024-02-10T08:59:19.350446+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[38951]: audit 2024-02-10T08:59:19.352227+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[38951]: audit 2024-02-10T08:59:19.352513+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[35794]: audit 2024-02-10T08:59:19.346466+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[35794]: audit 2024-02-10T08:59:19.350446+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:19.730 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[35794]: audit 2024-02-10T08:59:19.352227+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:19.731 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:19 smithi040 bash[35794]: audit 2024-02-10T08:59:19.352513+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[35820]: cluster 2024-02-10T08:59:18.383851+0000 mgr.y (mgr.14883) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[35820]: audit 2024-02-10T08:59:19.345797+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[35820]: audit 2024-02-10T08:59:19.346466+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[35820]: audit 2024-02-10T08:59:19.350446+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 188743680, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209160Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 49115299, \"cpu_percentage\": \"107.84%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:06.209353Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51600424, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209452Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209539Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47563407, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209624Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48706355, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.209707Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209789Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37088133, \"cpu_percentage\": \"0.37%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:06.209951Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40412119, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:06.210031Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[35820]: audit 2024-02-10T08:59:19.352227+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:19 smithi145 bash[35820]: audit 2024-02-10T08:59:19.352513+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:21 smithi145 bash[35820]: cluster 2024-02-10T08:59:20.384619+0000 mgr.y (mgr.14883) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:21.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:21 smithi040 bash[35794]: cluster 2024-02-10T08:59:20.384619+0000 mgr.y (mgr.14883) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:21.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:21 smithi040 bash[38951]: cluster 2024-02-10T08:59:20.384619+0000 mgr.y (mgr.14883) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:23.584 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:23 smithi040 bash[35794]: cluster 2024-02-10T08:59:22.385009+0000 mgr.y (mgr.14883) 43 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:23.584 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:23 smithi040 bash[38951]: cluster 2024-02-10T08:59:22.385009+0000 mgr.y (mgr.14883) 43 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:23 smithi145 bash[35820]: cluster 2024-02-10T08:59:22.385009+0000 mgr.y (mgr.14883) 43 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:24 smithi145 bash[35820]: audit 2024-02-10T08:59:23.912339+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:24 smithi145 bash[35820]: audit 2024-02-10T08:59:23.912866+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:24.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:24 smithi145 bash[35820]: audit 2024-02-10T08:59:23.918202+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:24.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:24 smithi040 bash[35794]: audit 2024-02-10T08:59:23.912339+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:24.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:24 smithi040 bash[38951]: audit 2024-02-10T08:59:23.912339+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:24.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:24 smithi040 bash[35794]: audit 2024-02-10T08:59:23.912866+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:24.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:24 smithi040 bash[35794]: audit 2024-02-10T08:59:23.918202+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:24.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:24 smithi040 bash[38951]: audit 2024-02-10T08:59:23.912866+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:24.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:24 smithi040 bash[38951]: audit 2024-02-10T08:59:23.918202+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"9592d18b7b6a\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 27336376, \"cpu_percentage\": \"0.10%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910967Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:46:01.383663Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:45:52.137788Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:23.911164Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:25.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: cluster 2024-02-10T08:59:24.385693+0000 mgr.y (mgr.14883) 44 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.602386+0000 mon.c (mon.1) 259 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.603029+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.607116+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.609392+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.609742+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.613345+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.619472+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.620589+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:25.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.620938+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.622560+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.624012+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.625603+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.627020+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.628124+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.629278+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.630460+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:25 smithi145 bash[35820]: audit 2024-02-10T08:59:24.631877+0000 mon.c (mon.1) 270 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: cluster 2024-02-10T08:59:24.385693+0000 mgr.y (mgr.14883) 44 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:25.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: cluster 2024-02-10T08:59:24.385693+0000 mgr.y (mgr.14883) 44 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:25.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.602386+0000 mon.c (mon.1) 259 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:25.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.602386+0000 mon.c (mon.1) 259 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:25.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.603029+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:25.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.603029+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.607116+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.609392+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.609742+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.613345+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.619472+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.620589+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:25.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.620938+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.622560+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.624012+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.625603+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.627020+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.628124+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.629278+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.630460+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[35794]: audit 2024-02-10T08:59:24.631877+0000 mon.c (mon.1) 270 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.607116+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"37cd9848751b\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 55585013, \"cpu_percentage\": \"0.29%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600648Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:46:14.866170Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:46:02.983597Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:24.601033Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:25.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.609392+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.609742+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.613345+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.619472+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.620589+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.620938+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.622560+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.624012+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.625603+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.627020+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.628124+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.629278+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.630460+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:25.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:25 smithi040 bash[38951]: audit 2024-02-10T08:59:24.631877+0000 mon.c (mon.1) 270 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:27 smithi145 bash[35820]: cephadm 2024-02-10T08:59:26.205565+0000 mgr.y (mgr.14883) 45 : cephadm [INF] Upgrade: Updating prometheus.a 2024-02-10T08:59:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:27 smithi145 bash[35820]: cephadm 2024-02-10T08:59:26.218458+0000 mgr.y (mgr.14883) 46 : cephadm [INF] Deploying daemon prometheus.a on smithi145 2024-02-10T08:59:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:27 smithi145 bash[35820]: cluster 2024-02-10T08:59:26.386277+0000 mgr.y (mgr.14883) 47 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:27.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:27 smithi040 bash[35794]: cephadm 2024-02-10T08:59:26.205565+0000 mgr.y (mgr.14883) 45 : cephadm [INF] Upgrade: Updating prometheus.a 2024-02-10T08:59:27.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:27 smithi040 bash[35794]: cephadm 2024-02-10T08:59:26.218458+0000 mgr.y (mgr.14883) 46 : cephadm [INF] Deploying daemon prometheus.a on smithi145 2024-02-10T08:59:27.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:27 smithi040 bash[35794]: cluster 2024-02-10T08:59:26.386277+0000 mgr.y (mgr.14883) 47 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:27.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:27 smithi040 bash[38951]: cephadm 2024-02-10T08:59:26.205565+0000 mgr.y (mgr.14883) 45 : cephadm [INF] Upgrade: Updating prometheus.a 2024-02-10T08:59:27.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:27 smithi040 bash[38951]: cephadm 2024-02-10T08:59:26.218458+0000 mgr.y (mgr.14883) 46 : cephadm [INF] Deploying daemon prometheus.a on smithi145 2024-02-10T08:59:27.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:27 smithi040 bash[38951]: cluster 2024-02-10T08:59:26.386277+0000 mgr.y (mgr.14883) 47 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[35820]: cluster 2024-02-10T08:59:28.386707+0000 mgr.y (mgr.14883) 48 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:29.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 systemd[1]: Stopping Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:29.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:29 smithi040 bash[35794]: cluster 2024-02-10T08:59:28.386707+0000 mgr.y (mgr.14883) 48 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:29 smithi040 bash[38951]: cluster 2024-02-10T08:59:28.386707+0000 mgr.y (mgr.14883) 48 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:874 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:898 level=info msg="Stopping scrape discovery manager..." 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:912 level=info msg="Stopping notify discovery manager..." 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:894 level=info msg="Scrape discovery manager stopped" 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-10T08:59:30.193 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:949 level=info msg="Stopping scrape manager..." 2024-02-10T08:59:30.194 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:908 level=info msg="Notify discovery manager stopped" 2024-02-10T08:59:30.194 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.812Z caller=main.go:941 level=info msg="Scrape manager stopped" 2024-02-10T08:59:30.194 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.814Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-10T08:59:30.194 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.814Z caller=main.go:1171 level=info msg="Notifier manager stopped" 2024-02-10T08:59:30.194 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:29 smithi145 bash[50992]: ts=2024-02-10T08:59:29.814Z caller=main.go:1183 level=info msg="See you next time!" 2024-02-10T08:59:30.532 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:30 smithi145 bash[58045]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a 2024-02-10T08:59:31.494 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service: Succeeded. 2024-02-10T08:59:31.495 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 systemd[1]: Stopped Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:31.495 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 systemd[1]: Starting Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:31 smithi145 bash[35820]: cluster 2024-02-10T08:59:30.387472+0000 mgr.y (mgr.14883) 49 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:31.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:31 smithi040 bash[35794]: cluster 2024-02-10T08:59:30.387472+0000 mgr.y (mgr.14883) 49 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:31.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:31 smithi040 bash[38951]: cluster 2024-02-10T08:59:30.387472+0000 mgr.y (mgr.14883) 49 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.792Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.792Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.792Z caller=main.go:518 level=info host_details="(Linux 4.18.0-536.el8.x86_64 #1 SMP Thu Jan 18 15:15:29 UTC 2024 x86_64 smithi145 (none))" 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.792Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.792Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.794Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.794Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.795Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.798Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-10T08:59:32.283 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.798Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=785.469µs 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.798Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.799Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 bash[58227]: b6b7f64e78cbe2c71f585054f7e89de9f97c57cf7df7ac4a196852f302a3c33d 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 systemd[1]: Started Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:31.989Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.018Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.019Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.019Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=39.377µs wal_replay_duration=220.243663ms total_replay_duration=221.086383ms 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.021Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.021Z caller=main.go:947 level=info msg="TSDB started" 2024-02-10T08:59:32.284 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.021Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-10T08:59:32.285 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.038Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=17.719833ms db_storage=641ns remote_storage=1.143µs web_handler=384ns query_engine=647ns scrape=483.032µs scrape_sd=27.181µs notify=23.355µs notify_sd=6.895µs rules=16.887642ms 2024-02-10T08:59:32.285 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 08:59:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T08:59:32.039Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-02-10T08:59:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:32 smithi145 bash[35820]: audit 2024-02-10T08:59:31.905532+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:32 smithi145 bash[35820]: audit 2024-02-10T08:59:31.906068+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:32 smithi145 bash[35820]: audit 2024-02-10T08:59:31.909221+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:32.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:32 smithi145 bash[35820]: audit 2024-02-10T08:59:31.910766+0000 mon.c (mon.1) 272 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:32.827 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[38951]: audit 2024-02-10T08:59:31.905532+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:32.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[35794]: audit 2024-02-10T08:59:31.905532+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:32.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[35794]: audit 2024-02-10T08:59:31.906068+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:32.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[35794]: audit 2024-02-10T08:59:31.909221+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:32.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[35794]: audit 2024-02-10T08:59:31.910766+0000 mon.c (mon.1) 272 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:32.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[38951]: audit 2024-02-10T08:59:31.906068+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:32.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[38951]: audit 2024-02-10T08:59:31.909221+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 189792256, \"cpu_percentage\": \"0.89%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600021Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404016332, \"cpu_percentage\": \"32.06%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:24.600224Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600318Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600402Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47584378, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600487Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48737812, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600567Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3470786, \"cpu_percentage\": \"9.29%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:24.600726Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-10T08:59:24.600804Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40496005, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:24.600883Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:32.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:32 smithi040 bash[38951]: audit 2024-02-10T08:59:31.910766+0000 mon.c (mon.1) 272 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:33.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:33 smithi145 bash[35820]: cluster 2024-02-10T08:59:32.388048+0000 mgr.y (mgr.14883) 50 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:33.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:33 smithi040 bash[35794]: cluster 2024-02-10T08:59:32.388048+0000 mgr.y (mgr.14883) 50 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:33.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:33 smithi040 bash[38951]: cluster 2024-02-10T08:59:32.388048+0000 mgr.y (mgr.14883) 50 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:34.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:34 smithi145 bash[35820]: cluster 2024-02-10T08:59:34.388933+0000 mgr.y (mgr.14883) 51 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:34 smithi040 bash[35794]: cluster 2024-02-10T08:59:34.388933+0000 mgr.y (mgr.14883) 51 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:34.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:34 smithi040 bash[38951]: cluster 2024-02-10T08:59:34.388933+0000 mgr.y (mgr.14883) 51 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:37 smithi145 bash[35820]: cluster 2024-02-10T08:59:36.389459+0000 mgr.y (mgr.14883) 52 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:37.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:37 smithi040 bash[35794]: cluster 2024-02-10T08:59:36.389459+0000 mgr.y (mgr.14883) 52 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:37.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:37 smithi040 bash[38951]: cluster 2024-02-10T08:59:36.389459+0000 mgr.y (mgr.14883) 52 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:38.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.518074+0000 mon.c (mon.1) 273 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:38.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.518074+0000 mon.c (mon.1) 273 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:38.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.518660+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.518660+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.524820+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.526851+0000 mon.c (mon.1) 274 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.527221+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.532547+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.540243+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.542517+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.543619+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.543935+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.545532+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.547179+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.548873+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.550269+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.524820+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.526851+0000 mon.c (mon.1) 274 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.527221+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.532547+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.540243+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.542517+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.543619+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.543935+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:38.639 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.545532+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.547179+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.548873+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.550269+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.551322+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.552358+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.553451+0000 mon.c (mon.1) 284 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.554837+0000 mon.c (mon.1) 285 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:37.556102+0000 mon.c (mon.1) 286 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.418507+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.418717+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.640 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.418799+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.418929+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.419189+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.419210+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.419592+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[38951]: audit 2024-02-10T08:59:38.419837+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.551322+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.552358+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.553451+0000 mon.c (mon.1) 284 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.554837+0000 mon.c (mon.1) 285 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:37.556102+0000 mon.c (mon.1) 286 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.418507+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.418717+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.418799+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-10T08:59:38.642 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.418929+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.642 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.419189+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.642 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.419210+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.642 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.419592+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.642 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:38 smithi040 bash[35794]: audit 2024-02-10T08:59:38.419837+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.518074+0000 mon.c (mon.1) 273 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.518660+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.524820+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"def7846928ea\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 37098618, \"cpu_percentage\": \"0.38%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516472Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T08:36:40.964204Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:36:23.343556Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:37.516703Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.526851+0000 mon.c (mon.1) 274 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.527221+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.532547+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.540243+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.542517+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:38.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.543619+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.543935+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.545532+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.547179+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.548873+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.550269+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.551322+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.552358+0000 mon.c (mon.1) 283 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.553451+0000 mon.c (mon.1) 284 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.554837+0000 mon.c (mon.1) 285 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:37.556102+0000 mon.c (mon.1) 286 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.418507+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.418717+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.418799+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-10T08:59:38.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.418929+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.419189+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.419210+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.419592+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T08:59:38.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:38 smithi145 bash[35820]: audit 2024-02-10T08:59:38.419837+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T08:59:39.780 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:39 smithi040 bash[38951]: audit 2024-02-10T08:59:37.540732+0000 mgr.y (mgr.14883) 53 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:59:39.781 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:39 smithi040 bash[38951]: cluster 2024-02-10T08:59:38.389850+0000 mgr.y (mgr.14883) 54 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:39.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:39 smithi040 bash[35794]: audit 2024-02-10T08:59:37.540732+0000 mgr.y (mgr.14883) 53 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:59:39.781 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:39 smithi040 bash[35794]: cluster 2024-02-10T08:59:38.389850+0000 mgr.y (mgr.14883) 54 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:39 smithi145 bash[35820]: audit 2024-02-10T08:59:37.540732+0000 mgr.y (mgr.14883) 53 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-10T08:59:39.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:39 smithi145 bash[35820]: cluster 2024-02-10T08:59:38.389850+0000 mgr.y (mgr.14883) 54 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:40 smithi145 bash[35820]: cephadm 2024-02-10T08:59:38.961504+0000 mgr.y (mgr.14883) 55 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-02-10T08:59:40.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:40 smithi145 bash[35820]: cephadm 2024-02-10T08:59:38.967151+0000 mgr.y (mgr.14883) 56 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-10T08:59:40.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:40 smithi040 bash[35794]: cephadm 2024-02-10T08:59:38.961504+0000 mgr.y (mgr.14883) 55 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-02-10T08:59:40.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:40 smithi040 bash[35794]: cephadm 2024-02-10T08:59:38.967151+0000 mgr.y (mgr.14883) 56 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-10T08:59:40.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:40 smithi040 bash[38951]: cephadm 2024-02-10T08:59:38.961504+0000 mgr.y (mgr.14883) 55 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-02-10T08:59:40.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:40 smithi040 bash[38951]: cephadm 2024-02-10T08:59:38.967151+0000 mgr.y (mgr.14883) 56 : cephadm [INF] Deploying daemon alertmanager.a on smithi040 2024-02-10T08:59:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:41 smithi145 bash[35820]: cluster 2024-02-10T08:59:40.390644+0000 mgr.y (mgr.14883) 57 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:41.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:41 smithi040 bash[35794]: cluster 2024-02-10T08:59:40.390644+0000 mgr.y (mgr.14883) 57 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:41.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:41 smithi040 bash[38951]: cluster 2024-02-10T08:59:40.390644+0000 mgr.y (mgr.14883) 57 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:42.300 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:42 smithi040 systemd[1]: Stopping Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:42.324 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T08:59:42.607 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:42 smithi040 bash[59999]: ts=2024-02-10T08:59:42.299Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-10T08:59:42.925 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:42 smithi040 bash[69829]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (13m) 19s ago 23m 26.0M - 0.26.0 9f27df16978d 9592d18b7b6a 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (23m) 5s ago 23m 35.3M - 6.6.2 87a51ecf0b1c def7846928ea 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (43s) 5s ago 26m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (10m) 19s ago 28m 417M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (28m) 19s ago 28m 212M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (27m) 5s ago 27m 186M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (27m) 19s ago 27m 182M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T08:59:42.966 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (31s) 19s ago 23m 3636k - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (24s) 5s ago 23m 12.3M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (26m) 19s ago 26m 48.9M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (26m) 19s ago 26m 46.1M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (25m) 19s ago 25m 45.2M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (25m) 19s ago 25m 50.3M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (25m) 5s ago 25m 49.1M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (24m) 5s ago 24m 45.4M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (24m) 5s ago 24m 45.3M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (24m) 5s ago 24m 46.4M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (11s) 5s ago 23m 38.5M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (21m) 19s ago 21m 39.1M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T08:59:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (21m) 5s ago 21m 38.6M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T08:59:43.405 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T08:59:43.406 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T08:59:43.406 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T08:59:43.406 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T08:59:43.406 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T08:59:43.406 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T08:59:43.406 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [ 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr" 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "2/2 daemons upgraded", 2024-02-10T08:59:43.767 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-10T08:59:43.768 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T08:59:43.768 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T08:59:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.311292+0000 mgr.y (mgr.14883) 58 : audit [DBG] from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: cluster 2024-02-10T08:59:42.390976+0000 mgr.y (mgr.14883) 59 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.956538+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.956921+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.957263+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.957575+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.957884+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.958198+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.959831+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.960136+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.960439+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.960726+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:42.961009+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:43 smithi145 bash[35820]: audit 2024-02-10T08:59:43.404932+0000 mon.a (mon.0) 879 : audit [DBG] from='client.? 172.21.15.40:0/362433226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:43.925 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:43 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-10T08:59:43.926 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:43 smithi040 systemd[1]: Stopped Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:43.926 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:43 smithi040 systemd[1]: Starting Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.311292+0000 mgr.y (mgr.14883) 58 : audit [DBG] from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: cluster 2024-02-10T08:59:42.390976+0000 mgr.y (mgr.14883) 59 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.956538+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.956921+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.957263+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.957575+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.957884+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.958198+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.959831+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.960136+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.960439+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.960726+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:42.961009+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[35794]: audit 2024-02-10T08:59:43.404932+0000 mon.a (mon.0) 879 : audit [DBG] from='client.? 172.21.15.40:0/362433226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.311292+0000 mgr.y (mgr.14883) 58 : audit [DBG] from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: cluster 2024-02-10T08:59:42.390976+0000 mgr.y (mgr.14883) 59 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.956538+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.956921+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.957263+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.957575+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.957884+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.958198+0000 mon.c (mon.1) 296 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.959831+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.960136+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.960439+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.960726+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:42.961009+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T08:59:43.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:43 smithi040 bash[38951]: audit 2024-02-10T08:59:43.404932+0000 mon.a (mon.0) 879 : audit [DBG] from='client.? 172.21.15.40:0/362433226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.261Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.261Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.263Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.40 port=9094 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.264Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.289Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.289Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.292Z caller=main.go:518 msg=Listening address=:9093 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:44.292Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[70111]: ea79f9a9c57ea107e2527e63e55091ed291645570c16a2d3b8e189e212ecd4c8 2024-02-10T08:59:44.676 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:44 smithi040 systemd[1]: Started Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T08:59:44.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[38951]: audit 2024-02-10T08:59:42.641364+0000 mgr.y (mgr.14883) 60 : audit [DBG] from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:44.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[38951]: audit 2024-02-10T08:59:42.954573+0000 mgr.y (mgr.14883) 61 : audit [DBG] from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:44.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[35794]: audit 2024-02-10T08:59:42.641364+0000 mgr.y (mgr.14883) 60 : audit [DBG] from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:44.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[35794]: audit 2024-02-10T08:59:42.954573+0000 mgr.y (mgr.14883) 61 : audit [DBG] from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:44.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[38951]: audit 2024-02-10T08:59:44.394582+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:44.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[35794]: audit 2024-02-10T08:59:44.394582+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:44.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[38951]: audit 2024-02-10T08:59:44.395047+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:44.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[38951]: audit 2024-02-10T08:59:44.398294+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:44.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[38951]: audit 2024-02-10T08:59:44.400185+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:44.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[35794]: audit 2024-02-10T08:59:44.395047+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:44.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[35794]: audit 2024-02-10T08:59:44.398294+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:44.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:44 smithi040 bash[35794]: audit 2024-02-10T08:59:44.400185+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:44.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:44 smithi145 bash[35820]: audit 2024-02-10T08:59:42.641364+0000 mgr.y (mgr.14883) 60 : audit [DBG] from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:44.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:44 smithi145 bash[35820]: audit 2024-02-10T08:59:42.954573+0000 mgr.y (mgr.14883) 61 : audit [DBG] from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:44.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:44 smithi145 bash[35820]: audit 2024-02-10T08:59:44.394582+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:44.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:44 smithi145 bash[35820]: audit 2024-02-10T08:59:44.395047+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:44.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:44 smithi145 bash[35820]: audit 2024-02-10T08:59:44.398294+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 222717542, \"cpu_percentage\": \"1.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910353Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 437570764, \"cpu_percentage\": \"3.39%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:23.910502Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 190840832, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910576Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910644Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910711Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47406120, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910776Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52753858, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.910840Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 3723493, \"cpu_percentage\": \"0.47%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:23.910903Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41062236, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:23.911029Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:44.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:44 smithi145 bash[35820]: audit 2024-02-10T08:59:44.400185+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T08:59:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:45 smithi145 bash[35820]: audit 2024-02-10T08:59:43.765626+0000 mgr.y (mgr.14883) 62 : audit [DBG] from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:45 smithi145 bash[35820]: cluster 2024-02-10T08:59:44.391541+0000 mgr.y (mgr.14883) 63 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:45.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:45 smithi040 bash[35794]: audit 2024-02-10T08:59:43.765626+0000 mgr.y (mgr.14883) 62 : audit [DBG] from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:45.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:45 smithi040 bash[35794]: cluster 2024-02-10T08:59:44.391541+0000 mgr.y (mgr.14883) 63 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:45.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:45 smithi040 bash[38951]: audit 2024-02-10T08:59:43.765626+0000 mgr.y (mgr.14883) 62 : audit [DBG] from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T08:59:45.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:45 smithi040 bash[38951]: cluster 2024-02-10T08:59:44.391541+0000 mgr.y (mgr.14883) 63 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:46.675 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:46.264Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000116404s 2024-02-10T08:59:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:47 smithi145 bash[35820]: cluster 2024-02-10T08:59:46.391864+0000 mgr.y (mgr.14883) 64 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:47.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:47 smithi040 bash[35794]: cluster 2024-02-10T08:59:46.391864+0000 mgr.y (mgr.14883) 64 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:47.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:47 smithi040 bash[38951]: cluster 2024-02-10T08:59:46.391864+0000 mgr.y (mgr.14883) 64 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:49.749 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: cluster 2024-02-10T08:59:48.392247+0000 mgr.y (mgr.14883) 65 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:49.749 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.613675+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:49.749 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.614178+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:49.749 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.618526+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:49.749 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.912154+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:49.749 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.912469+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.916545+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.922480+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.924183+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.925010+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.925250+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.926725+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.928094+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.929636+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.930976+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.931987+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.932970+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.933913+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.935180+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.936309+0000 mon.c (mon.1) 317 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.750 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:49 smithi145 bash[35820]: audit 2024-02-10T08:59:48.937491+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: cluster 2024-02-10T08:59:48.392247+0000 mgr.y (mgr.14883) 65 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:49.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: cluster 2024-02-10T08:59:48.392247+0000 mgr.y (mgr.14883) 65 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:49.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.613675+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:49.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.613675+0000 mon.c (mon.1) 304 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.614178+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.618526+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.912154+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.912469+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.916545+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.922480+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.924183+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.925010+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.925250+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:49.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.926725+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.928094+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.929636+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.930976+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.931987+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.932970+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.933913+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.935180+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.936309+0000 mon.c (mon.1) 317 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[38951]: audit 2024-02-10T08:59:48.937491+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.614178+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.618526+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"8e2006e02dbc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 253126246, \"cpu_percentage\": \"1.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611716Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T08:31:04.212334Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:49.053276Z\"}}, \"last_daemon_update\": \"2024-02-10T08:59:48.612500Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.912154+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.912469+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.916545+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.922480+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.924183+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.925010+0000 mon.c (mon.1) 308 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.925250+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.926725+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.928094+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.929636+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.930976+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.931987+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.932970+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.933913+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.935180+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.936309+0000 mon.c (mon.1) 317 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:49.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:49 smithi040 bash[35794]: audit 2024-02-10T08:59:48.937491+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T08:59:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:50 smithi145 bash[35820]: audit 2024-02-10T08:59:48.922788+0000 mgr.y (mgr.14883) 66 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:59:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:50 smithi145 bash[35820]: cluster 2024-02-10T08:59:50.393005+0000 mgr.y (mgr.14883) 67 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:50.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:50 smithi145 bash[35820]: cephadm 2024-02-10T08:59:50.454467+0000 mgr.y (mgr.14883) 68 : cephadm [INF] Upgrade: Updating grafana.a 2024-02-10T08:59:50.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:50 smithi040 bash[35794]: audit 2024-02-10T08:59:48.922788+0000 mgr.y (mgr.14883) 66 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:59:50.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:50 smithi040 bash[35794]: cluster 2024-02-10T08:59:50.393005+0000 mgr.y (mgr.14883) 67 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:50.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:50 smithi040 bash[35794]: cephadm 2024-02-10T08:59:50.454467+0000 mgr.y (mgr.14883) 68 : cephadm [INF] Upgrade: Updating grafana.a 2024-02-10T08:59:50.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:50 smithi040 bash[38951]: audit 2024-02-10T08:59:48.922788+0000 mgr.y (mgr.14883) 66 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-10T08:59:50.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:50 smithi040 bash[38951]: cluster 2024-02-10T08:59:50.393005+0000 mgr.y (mgr.14883) 67 : cluster [DBG] pgmap v39: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:50.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:50 smithi040 bash[38951]: cephadm 2024-02-10T08:59:50.454467+0000 mgr.y (mgr.14883) 68 : cephadm [INF] Upgrade: Updating grafana.a 2024-02-10T08:59:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.534545+0000 mon.c (mon.1) 319 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:59:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.534898+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:59:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.538364+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.538997+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.539282+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.542377+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.545230+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.545612+0000 mgr.y (mgr.14883) 69 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.545943+0000 mon.c (mon.1) 322 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.546230+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: audit 2024-02-10T08:59:50.551756+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2024-02-10T08:59:51.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:51 smithi145 bash[35820]: cephadm 2024-02-10T08:59:50.559931+0000 mgr.y (mgr.14883) 70 : cephadm [INF] Deploying daemon grafana.a on smithi145 2024-02-10T08:59:51.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.534545+0000 mon.c (mon.1) 319 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:59:51.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.534898+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:59:51.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.538364+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:59:51.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.534545+0000 mon.c (mon.1) 319 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:59:51.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.534898+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-10T08:59:51.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.538364+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICyjCCAbICEQCLXDKM+n1FUIU5d12yVf5jMA0GCSqGSIb3DQEBDQUAMCMxDTAL\nBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRoaTE0NTAeFw0yNDAyMTAwODU5NTBa\nFw0zNDAyMDcwODU5NTBaMCMxDTALBgNVBAoMBENlcGgxEjAQBgNVBAMMCXNtaXRo\naTE0NTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBANi37o2rNZ9+AmJ4\neojm4pvJeZCFBO/ye7x+pt4h69Gdj8nvL2F/eXvqfu/aplwrPNI6+6Z7DBVDKgw7\ncEXRNTUj73o8L7/ik5AS/cgeu6/iB0Dw+SwFeCmZ09nZhqeNFQqDVFEB82d4aDtu\nCCHb4jAZmgboJ3OuH6bQSkIjvpnR41pd+h/UVrMsLBkEGHs6FuJDoOtsbkuorAh/\nhDFM70UlBct1Je2eKJ3m7k2w3m7FmOPcgCF28PX/MlgGGsvAZGs14rLnWdthec3T\n6Xt4yMftHd9b1hqDoCCD2Ty7dz3acprZsi360YM1ot3WKZ1Xj3fGQp4IE5tiUtZ8\nP3lM0jsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAibMFopbf1knnVOapK2gooeTB\nHk8efIy/QdFY1luglsDr/bDyHAM4T5V9fdBQCzzAc3Y/f+/6IjGYKnQ0BXvr6CV0\nggpnR//sd5ivvb7O+KWiS0zFYn0djmfgiZfjTn0aAdIi5mJpJG8Gno0qTdeqK+/U\n7vdMlsR0LIyS/QghJlWUre/mA4PbFp6W6XX5jsWG1KvAWcHAUCe+L7aByAQrecNq\nXqhSCjHVtgjqwbUlgK1fMShDPlkpcojYYHJMERPuZ0om6y3Z02YJVE8HpsKAcIAA\ncvhJgUTKXHbYJb2yyIcQ03LE/3sKDADgeo0vhsaa5EQg7hO59wK6MP/aOGtoRQ==\n-----END CERTIFICATE-----\n"}]': finished 2024-02-10T08:59:51.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.538997+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:59:51.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.539282+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:59:51.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.538997+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:59:51.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.539282+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-10T08:59:51.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.542377+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:59:51.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.545230+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:59:51.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.545612+0000 mgr.y (mgr.14883) 69 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:59:51.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.545943+0000 mon.c (mon.1) 322 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-02-10T08:59:51.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.546230+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-02-10T08:59:51.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: audit 2024-02-10T08:59:50.551756+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2024-02-10T08:59:51.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[35794]: cephadm 2024-02-10T08:59:50.559931+0000 mgr.y (mgr.14883) 70 : cephadm [INF] Deploying daemon grafana.a on smithi145 2024-02-10T08:59:51.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.542377+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/smithi145/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDYt+6NqzWffgJi\neHqI5uKbyXmQhQTv8nu8fqbeIevRnY/J7y9hf3l76n7v2qZcKzzSOvumewwVQyoM\nO3BF0TU1I+96PC+/4pOQEv3IHruv4gdA8PksBXgpmdPZ2YanjRUKg1RRAfNneGg7\nbggh2+IwGZoG6Cdzrh+m0EpCI76Z0eNaXfof1FazLCwZBBh7OhbiQ6DrbG5LqKwI\nf4QxTO9FJQXLdSXtniid5u5NsN5uxZjj3IAhdvD1/zJYBhrLwGRrNeKy51nbYXnN\n0+l7eMjH7R3fW9Yag6Agg9k8u3c92nKa2bIt+tGDNaLd1imdV493xkKeCBObYlLW\nfD95TNI7AgMBAAECggEBAI7T6eyEQbrzmS68qEVBpWd2yR9uC2r4LIR2FBOh14E2\njmVPtbJUCQSZ7z60o59q/5KuPNvjjHsW4MdfBQd+ccqr/FBbCj00Xnw9h/Q0DQ5F\nsPIj3pQcpq0ELJMOwaf7Wzqqgw9AceJngIpqYgGuoMuCk/ipWBbtUv7ll4svc5Z7\nfxokXKW+yesRwzlmBp3n1YYDuYWd5l6SbmeKT/dxUm66mxlc7HuazBydOFd4rd5O\nNztbFnKoRGX8PGfoshYIpAMmMh7CErWLPozQectMwPJHpA0pZLRg2UDFhouqLxFh\nk5VH6EgMIBFOdLI/DxALu0M9DvEk6pm3QVnoCuqjOMECgYEA7FSiWBXg4uFSKa98\n4KAVmzvYesLCsDKHYImSNtLD0qROL7u1M4veEoIgnsYu6KmWnivCpbCy1rVSVZgS\n1eGWEK0xGtumm9bBz/wVEgLSTJ38gWabfSIBSQZ1btax+V7UegiRUBQQ8V1RjRme\nWfkEYDT2pN+tChRRbgHQseGPuX0CgYEA6sFu35KVhd/RS4Jd6ykmvRjfs2dZxnbd\n+1nLvAc8GMmKM2aFcq/ZXGH9eUZyVBZJ1N8ofoOM6muJJMw/jM4gT2epJC2ezqnV\ndNrnDxFvE+a/ZzHhGd985sNjApj1Lm2NdP+Obm4A93HQInhITd588ExjHXIurk6V\nEnAv3POYSBcCgYBgmlPmF8NeWmZAfehY1Xcfhj3+KEB2z6DA2Fs5J7w+DUWcg2kV\nUfYLsL9ux2oDVtcnfpHJMspXs7SdIlWIsfaqiHELHoAjMYz13IAsZZTbFrVRm8Sx\nSMYnuIkmLoJ/gcDuxTPI/PrT/qZIPBGbi4u7W8r6KChOd3G1uu442A/s7QKBgQCO\nFqQ4GC3+SLkSXgbglhjHba3AlbaF5F55iyFAXpSmYB4Q/GWbRApo2zqjU9tRP+hS\nOvv0j0UUgiARMLrqS7zMsu5yYlZzueHkB7bArQmxXwHMwSkBEv8zYWGlKdWE03RC\nM4gPGO/m1XFn26vPzfGLNIDtSrYsdI3QCi0+LAao4wKBgQChNCkFPSpKSSfsou6f\n+asciRzGeqkCj6sFlJ49NHF0LlV9girCCmD8xX1u7v7f2c+/LrJqxrUGxH8R6wt0\nD1BJtVJ4gx/O3AASQDYX82K3zAin2+5SUAxv6C0gcqc6LdnRtMZREpL4nPpb2/4g\nR/g8c55BMs0+iOE3jdZtEAb7qg==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-10T08:59:51.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.545230+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:59:51.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.545612+0000 mgr.y (mgr.14883) 69 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-10T08:59:51.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.545943+0000 mon.c (mon.1) 322 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-02-10T08:59:51.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.546230+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]: dispatch 2024-02-10T08:59:51.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: audit 2024-02-10T08:59:50.551756+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config set","value":"False","who":"mgr","name":"mgr/dashboard/GRAFANA_API_SSL_VERIFY"}]': finished 2024-02-10T08:59:51.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:51 smithi040 bash[38951]: cephadm 2024-02-10T08:59:50.559931+0000 mgr.y (mgr.14883) 70 : cephadm [INF] Deploying daemon grafana.a on smithi145 2024-02-10T08:59:52.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:52 smithi145 bash[35820]: cluster 2024-02-10T08:59:52.393494+0000 mgr.y (mgr.14883) 71 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:52.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:52 smithi040 bash[35794]: cluster 2024-02-10T08:59:52.393494+0000 mgr.y (mgr.14883) 71 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:52.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:52 smithi040 bash[38951]: cluster 2024-02-10T08:59:52.393494+0000 mgr.y (mgr.14883) 71 : cluster [DBG] pgmap v40: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:54.675 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 08:59:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T08:59:54.267Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003225543s 2024-02-10T08:59:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:55 smithi145 bash[35820]: cluster 2024-02-10T08:59:54.394411+0000 mgr.y (mgr.14883) 72 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:55.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:55 smithi040 bash[35794]: cluster 2024-02-10T08:59:54.394411+0000 mgr.y (mgr.14883) 72 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:55 smithi040 bash[38951]: cluster 2024-02-10T08:59:54.394411+0000 mgr.y (mgr.14883) 72 : cluster [DBG] pgmap v41: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:57 smithi145 bash[35820]: cluster 2024-02-10T08:59:56.394877+0000 mgr.y (mgr.14883) 73 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:57.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:57 smithi040 bash[35794]: cluster 2024-02-10T08:59:56.394877+0000 mgr.y (mgr.14883) 73 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:57.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:57 smithi040 bash[38951]: cluster 2024-02-10T08:59:56.394877+0000 mgr.y (mgr.14883) 73 : cluster [DBG] pgmap v42: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 08:59:59 smithi145 bash[35820]: cluster 2024-02-10T08:59:58.395371+0000 mgr.y (mgr.14883) 74 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:59.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 08:59:59 smithi040 bash[35794]: cluster 2024-02-10T08:59:58.395371+0000 mgr.y (mgr.14883) 74 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T08:59:59.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 08:59:59 smithi040 bash[38951]: cluster 2024-02-10T08:59:58.395371+0000 mgr.y (mgr.14883) 74 : cluster [DBG] pgmap v43: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:00.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:00 smithi145 bash[35820]: cluster 2024-02-10T09:00:00.000157+0000 mon.a (mon.0) 893 : cluster [INF] overall HEALTH_OK 2024-02-10T09:00:00.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:00 smithi040 bash[35794]: cluster 2024-02-10T09:00:00.000157+0000 mon.a (mon.0) 893 : cluster [INF] overall HEALTH_OK 2024-02-10T09:00:00.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:00 smithi040 bash[38951]: cluster 2024-02-10T09:00:00.000157+0000 mon.a (mon.0) 893 : cluster [INF] overall HEALTH_OK 2024-02-10T09:00:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:01 smithi145 bash[35820]: cluster 2024-02-10T09:00:00.396174+0000 mgr.y (mgr.14883) 75 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:01 smithi040 bash[35794]: cluster 2024-02-10T09:00:00.396174+0000 mgr.y (mgr.14883) 75 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:01.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:01 smithi040 bash[38951]: cluster 2024-02-10T09:00:00.396174+0000 mgr.y (mgr.14883) 75 : cluster [DBG] pgmap v44: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:02.533 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 systemd[1]: Stopping Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:00:02.902 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-10T09:00:02.902 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2024-02-10T09:00:02.902 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2024-02-10T09:00:02.902 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2024-02-10T09:00:02.902 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2024-02-10T09:00:02.902 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=info msg="Stopped Stream Manager" 2024-02-10T09:00:02.903 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:02 smithi145 bash[45294]: t=2024-02-10T09:00:02+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2024-02-10T09:00:03.282 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:03 smithi145 bash[59227]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana.a 2024-02-10T09:00:03.718 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:03 smithi145 bash[35820]: cluster 2024-02-10T09:00:02.396565+0000 mgr.y (mgr.14883) 76 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:03.718 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:03 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-10T09:00:03.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:03 smithi040 bash[35794]: cluster 2024-02-10T09:00:02.396565+0000 mgr.y (mgr.14883) 76 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:03.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:03 smithi040 bash[38951]: cluster 2024-02-10T09:00:02.396565+0000 mgr.y (mgr.14883) 76 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:04.032 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:03 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-02-10T09:00:04.032 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:03 smithi145 systemd[1]: Stopped Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:00:04.033 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:03 smithi145 systemd[1]: Starting Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:00:04.767 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-10T09:00:04.768 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="App mode production" logger=settings 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-10T09:00:04.769 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-10T09:00:04.770 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-02-10T09:00:04.771 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-10T09:00:04.772 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-10T09:00:04.773 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 bash[59407]: c95486c769a17852724bdb1b318350309be975afc4277d8d4f880d8947604cc3 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 systemd[1]: Started Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:00:04.774 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-10T09:00:04.775 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-10T09:00:04.776 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-10T09:00:04.777 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-10T09:00:04.778 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-10T09:00:04.779 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-10T09:00:04.780 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-02-10T09:00:04.781 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-10T09:00:04.782 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-02-10T09:00:04.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-10T09:00:05.018 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-02-10T09:00:05.019 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-10T09:00:05.020 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-10T09:00:05.021 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-10T09:00:05.022 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-10T09:00:05.023 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-10T09:00:05.024 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-02-10T09:00:05.025 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-10T09:00:05.026 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-10T09:00:05.027 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-02-10T09:00:05.027 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-10T09:00:05.027 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-02-10T09:00:05.283 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-02-10T09:00:05.283 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-02-10T09:00:05.283 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-10T09:00:05.283 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-02-10T09:00:05.283 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-10T09:00:05.284 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-02-10T09:00:05.285 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-02-10T09:00:05.286 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-02-10T09:00:05.286 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-02-10T09:00:05.286 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-02-10T09:00:05.286 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-02-10T09:00:05.286 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-02-10T09:00:05.287 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-02-10T09:00:05.288 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=606.127335ms 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-02-10T09:00:05.289 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-10T09:00:05.290 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-10T09:00:05.290 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-02-10T09:00:05.290 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-02-10T09:00:05.290 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:00:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:00:05+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-02-10T09:00:05.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:05 smithi145 bash[35820]: cluster 2024-02-10T09:00:04.397408+0000 mgr.y (mgr.14883) 77 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:05 smithi145 bash[35820]: audit 2024-02-10T09:00:04.623248+0000 mon.c (mon.1) 323 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:05 smithi145 bash[35820]: audit 2024-02-10T09:00:04.623910+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:05 smithi145 bash[35820]: audit 2024-02-10T09:00:04.631026+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:05 smithi145 bash[35820]: audit 2024-02-10T09:00:04.632932+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:00:05.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[35794]: cluster 2024-02-10T09:00:04.397408+0000 mgr.y (mgr.14883) 77 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:05.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[38951]: cluster 2024-02-10T09:00:04.397408+0000 mgr.y (mgr.14883) 77 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:05.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[35794]: audit 2024-02-10T09:00:04.623248+0000 mon.c (mon.1) 323 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:05.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[38951]: audit 2024-02-10T09:00:04.623248+0000 mon.c (mon.1) 323 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:05.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[35794]: audit 2024-02-10T09:00:04.623910+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:05.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[35794]: audit 2024-02-10T09:00:04.631026+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:05.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[35794]: audit 2024-02-10T09:00:04.632932+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:00:05.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[38951]: audit 2024-02-10T09:00:04.623910+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:05.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[38951]: audit 2024-02-10T09:00:04.631026+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 195873996, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515670Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404121190, \"cpu_percentage\": \"20.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:37.515858Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51558481, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.515954Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47605350, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516040Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47594864, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516147Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516231Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 40433090, \"cpu_percentage\": \"51.20%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516312Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 12949913, \"cpu_percentage\": \"0.91%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:37.516392Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 40537948, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:37.516551Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:05.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:05 smithi040 bash[38951]: audit 2024-02-10T09:00:04.632932+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:00:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:07 smithi145 bash[35820]: cluster 2024-02-10T09:00:06.397907+0000 mgr.y (mgr.14883) 78 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:07.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:07 smithi040 bash[35794]: cluster 2024-02-10T09:00:06.397907+0000 mgr.y (mgr.14883) 78 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:07.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:07 smithi040 bash[38951]: cluster 2024-02-10T09:00:06.397907+0000 mgr.y (mgr.14883) 78 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:09.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:09 smithi145 bash[35820]: cluster 2024-02-10T09:00:08.398476+0000 mgr.y (mgr.14883) 79 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:09.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:09 smithi040 bash[35794]: cluster 2024-02-10T09:00:08.398476+0000 mgr.y (mgr.14883) 79 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:09.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:09 smithi040 bash[38951]: cluster 2024-02-10T09:00:08.398476+0000 mgr.y (mgr.14883) 79 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:09.775458+0000 mon.c (mon.1) 325 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:09.776160+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:09.780208+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.050764+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.051107+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.054707+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.063586+0000 mon.c (mon.1) 327 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T09:00:10.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.065098+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.065790+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.066118+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.070572+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.074500+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.076113+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.076470+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.078835+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.081766+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.083624+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.085722+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.087006+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.088296+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.089563+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.091219+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.092730+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.094193+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.095663+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.096669+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.096951+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.101288+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]': finished 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.102837+0000 mon.c (mon.1) 344 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.103166+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.107386+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.108276+0000 mon.c (mon.1) 345 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.108572+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.112396+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.113274+0000 mon.c (mon.1) 346 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.113558+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:10.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.117312+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.118159+0000 mon.c (mon.1) 347 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.118408+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.119100+0000 mon.c (mon.1) 348 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.119320+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.123028+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.123881+0000 mon.c (mon.1) 349 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.124209+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.124919+0000 mon.c (mon.1) 350 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:10.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.125171+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.128947+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.129916+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.130174+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.130848+0000 mon.c (mon.1) 352 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.131070+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.135824+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.136704+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.136958+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.141700+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.142525+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.142777+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.143452+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.143680+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.144363+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.144588+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.145232+0000 mon.c (mon.1) 357 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.145452+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.146082+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.146310+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.149749+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.151034+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.151272+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.153686+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.155232+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.155456+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.157954+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.163856+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.164117+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:10 smithi145 bash[35820]: audit 2024-02-10T09:00:10.166743+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:09.775458+0000 mon.c (mon.1) 325 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:10.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:09.775458+0000 mon.c (mon.1) 325 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:10.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:09.776160+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:09.776160+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:09.780208+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.050764+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.051107+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.054707+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.063586+0000 mon.c (mon.1) 327 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.065098+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T09:00:10.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.065790+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.066118+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:09.780208+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"250ee6899adc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 197446860, \"cpu_percentage\": \"0.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773149Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T08:32:39.037264Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:46:01.305547Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:09.774161Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.050764+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.051107+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.054707+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.063586+0000 mon.c (mon.1) 327 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.065098+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.065790+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.066118+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-10T09:00:10.830 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.070572+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.074500+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.076113+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.076470+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.078835+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.081766+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.083624+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.085722+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.087006+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.088296+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.089563+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.091219+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.092730+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.094193+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.095663+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.831 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.096669+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.096951+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.101288+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]': finished 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.070572+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi145.front.sepia.ceph.com:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.074500+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.076113+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.076470+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.078835+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.081766+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.083624+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.832 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.085722+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.087006+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.088296+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.089563+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.091219+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.092730+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.094193+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.095663+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.096669+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.096951+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.101288+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]': finished 2024-02-10T09:00:10.833 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.102837+0000 mon.c (mon.1) 344 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.103166+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.107386+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.108276+0000 mon.c (mon.1) 345 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.108572+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.112396+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.113274+0000 mon.c (mon.1) 346 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.113558+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.117312+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.118159+0000 mon.c (mon.1) 347 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.118408+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.119100+0000 mon.c (mon.1) 348 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.119320+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.123028+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.123881+0000 mon.c (mon.1) 349 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:10.834 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.124209+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.124919+0000 mon.c (mon.1) 350 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.102837+0000 mon.c (mon.1) 344 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.103166+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.107386+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.108276+0000 mon.c (mon.1) 345 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.108572+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.112396+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.113274+0000 mon.c (mon.1) 346 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:10.835 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.113558+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.117312+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.118159+0000 mon.c (mon.1) 347 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.118408+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.119100+0000 mon.c (mon.1) 348 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.119320+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.123028+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.123881+0000 mon.c (mon.1) 349 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.124209+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.124919+0000 mon.c (mon.1) 350 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.125171+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.128947+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.129916+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.130174+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.836 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.130848+0000 mon.c (mon.1) 352 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.131070+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.135824+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.136704+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.136958+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.141700+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.142525+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.142777+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.143452+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.143680+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.144363+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.144588+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.145232+0000 mon.c (mon.1) 357 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.837 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.145452+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.125171+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.128947+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.129916+0000 mon.c (mon.1) 351 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.130174+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.130848+0000 mon.c (mon.1) 352 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.131070+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.135824+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.136704+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:10.838 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.136958+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.141700+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.142525+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.142777+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.143452+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.143680+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.144363+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.144588+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.145232+0000 mon.c (mon.1) 357 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.145452+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.146082+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.146310+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.149749+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.151034+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:10.839 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.151272+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.153686+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.155232+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.155456+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.157954+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.163856+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.164117+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[35794]: audit 2024-02-10T09:00:10.166743+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.146082+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.146310+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:10.840 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.149749+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.151034+0000 mon.c (mon.1) 359 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.151272+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.153686+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.155232+0000 mon.c (mon.1) 360 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.155456+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.157954+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.163856+0000 mon.c (mon.1) 361 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.164117+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:10.841 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:10 smithi040 bash[38951]: audit 2024-02-10T09:00:10.166743+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:11 smithi145 bash[35820]: audit 2024-02-10T09:00:10.064083+0000 mgr.y (mgr.14883) 80 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T09:00:11.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:11 smithi145 bash[35820]: audit 2024-02-10T09:00:10.065486+0000 mgr.y (mgr.14883) 81 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T09:00:11.917 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:11 smithi145 bash[35820]: cephadm 2024-02-10T09:00:10.096442+0000 mgr.y (mgr.14883) 82 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:00:11.917 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:11 smithi145 bash[35820]: cephadm 2024-02-10T09:00:10.150634+0000 mgr.y (mgr.14883) 83 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:00:11.917 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:11 smithi145 bash[35820]: cluster 2024-02-10T09:00:10.399260+0000 mgr.y (mgr.14883) 84 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:11.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[35794]: audit 2024-02-10T09:00:10.064083+0000 mgr.y (mgr.14883) 80 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T09:00:11.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[35794]: audit 2024-02-10T09:00:10.065486+0000 mgr.y (mgr.14883) 81 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[35794]: cephadm 2024-02-10T09:00:10.096442+0000 mgr.y (mgr.14883) 82 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[35794]: cephadm 2024-02-10T09:00:10.150634+0000 mgr.y (mgr.14883) 83 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[35794]: cluster 2024-02-10T09:00:10.399260+0000 mgr.y (mgr.14883) 84 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[38951]: audit 2024-02-10T09:00:10.064083+0000 mgr.y (mgr.14883) 80 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[38951]: audit 2024-02-10T09:00:10.065486+0000 mgr.y (mgr.14883) 81 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi145.front.sepia.ceph.com:3000"}]: dispatch 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[38951]: cephadm 2024-02-10T09:00:10.096442+0000 mgr.y (mgr.14883) 82 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[38951]: cephadm 2024-02-10T09:00:10.150634+0000 mgr.y (mgr.14883) 83 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:00:11.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:11 smithi040 bash[38951]: cluster 2024-02-10T09:00:10.399260+0000 mgr.y (mgr.14883) 84 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:12.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:12 smithi145 bash[35820]: cluster 2024-02-10T09:00:12.399839+0000 mgr.y (mgr.14883) 85 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:12.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:12 smithi040 bash[35794]: cluster 2024-02-10T09:00:12.399839+0000 mgr.y (mgr.14883) 85 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:12.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:12 smithi040 bash[38951]: cluster 2024-02-10T09:00:12.399839+0000 mgr.y (mgr.14883) 85 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:14.128 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:13 smithi040 bash[35794]: audit 2024-02-10T09:00:13.803094+0000 mon.c (mon.1) 362 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:14.128 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:13 smithi040 bash[35794]: audit 2024-02-10T09:00:13.803450+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:14.128 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:13 smithi040 bash[35794]: audit 2024-02-10T09:00:13.807405+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T09:00:14.129 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:13 smithi040 bash[38951]: audit 2024-02-10T09:00:13.803094+0000 mon.c (mon.1) 362 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:14.129 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:13 smithi040 bash[38951]: audit 2024-02-10T09:00:13.803450+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:14.129 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:13 smithi040 bash[38951]: audit 2024-02-10T09:00:13.807405+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T09:00:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:13 smithi145 bash[35820]: audit 2024-02-10T09:00:13.803094+0000 mon.c (mon.1) 362 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:13 smithi145 bash[35820]: audit 2024-02-10T09:00:13.803450+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:13 smithi145 bash[35820]: audit 2024-02-10T09:00:13.807405+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T09:00:14.864 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:14 smithi040 bash[35794]: audit 2024-02-10T09:00:14.091935+0000 mgr.y (mgr.14883) 86 : audit [DBG] from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:14.864 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:14 smithi040 bash[35794]: cluster 2024-02-10T09:00:14.400484+0000 mgr.y (mgr.14883) 87 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:14.865 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:14 smithi040 bash[38951]: audit 2024-02-10T09:00:14.091935+0000 mgr.y (mgr.14883) 86 : audit [DBG] from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:14.865 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:14 smithi040 bash[38951]: cluster 2024-02-10T09:00:14.400484+0000 mgr.y (mgr.14883) 87 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:14.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-10T09:00:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:14 smithi145 bash[35820]: audit 2024-02-10T09:00:14.091935+0000 mgr.y (mgr.14883) 86 : audit [DBG] from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:14 smithi145 bash[35820]: cluster 2024-02-10T09:00:14.400484+0000 mgr.y (mgr.14883) 87 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:16.921 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:00:17.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:17 smithi040 bash[35794]: cluster 2024-02-10T09:00:16.400855+0000 mgr.y (mgr.14883) 88 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:17.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:17 smithi040 bash[35794]: audit 2024-02-10T09:00:16.910033+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.15.40:0/3006706667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:17.657 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:17 smithi040 bash[38951]: cluster 2024-02-10T09:00:16.400855+0000 mgr.y (mgr.14883) 88 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:17.657 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:17 smithi040 bash[38951]: audit 2024-02-10T09:00:16.910033+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.15.40:0/3006706667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:17.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-10T09:00:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:17 smithi145 bash[35820]: cluster 2024-02-10T09:00:16.400855+0000 mgr.y (mgr.14883) 88 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:17 smithi145 bash[35820]: audit 2024-02-10T09:00:16.910033+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.15.40:0/3006706667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:19.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:19 smithi040 bash[35794]: cluster 2024-02-10T09:00:18.401371+0000 mgr.y (mgr.14883) 89 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:19.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:19 smithi040 bash[38951]: cluster 2024-02-10T09:00:18.401371+0000 mgr.y (mgr.14883) 89 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:19 smithi145 bash[35820]: cluster 2024-02-10T09:00:18.401371+0000 mgr.y (mgr.14883) 89 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-10T09:00:20.569 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:20 smithi040 bash[35794]: audit 2024-02-10T09:00:19.879912+0000 mon.c (mon.1) 363 : audit [DBG] from='client.? 172.21.15.40:0/3140514150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:20.570 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:20 smithi040 bash[38951]: audit 2024-02-10T09:00:19.879912+0000 mon.c (mon.1) 363 : audit [DBG] from='client.? 172.21.15.40:0/3140514150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:20.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-10T09:00:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:20 smithi145 bash[35820]: audit 2024-02-10T09:00:19.879912+0000 mon.c (mon.1) 363 : audit [DBG] from='client.? 172.21.15.40:0/3140514150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:21.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:21 smithi145 bash[35820]: cluster 2024-02-10T09:00:20.402109+0000 mgr.y (mgr.14883) 90 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:21.784 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:21 smithi040 bash[38951]: cluster 2024-02-10T09:00:20.402109+0000 mgr.y (mgr.14883) 90 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:21.784 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:21 smithi040 bash[35794]: cluster 2024-02-10T09:00:20.402109+0000 mgr.y (mgr.14883) 90 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:22.543 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:00:23.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-10T09:00:23.759 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:23 smithi040 bash[38951]: cluster 2024-02-10T09:00:22.402439+0000 mgr.y (mgr.14883) 91 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:23.759 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:23 smithi040 bash[38951]: audit 2024-02-10T09:00:22.532508+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.15.40:0/2503010287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:23.760 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:23 smithi040 bash[35794]: cluster 2024-02-10T09:00:22.402439+0000 mgr.y (mgr.14883) 91 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:23.760 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:23 smithi040 bash[35794]: audit 2024-02-10T09:00:22.532508+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.15.40:0/2503010287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:23 smithi145 bash[35820]: cluster 2024-02-10T09:00:22.402439+0000 mgr.y (mgr.14883) 91 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:23.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:23 smithi145 bash[35820]: audit 2024-02-10T09:00:22.532508+0000 mon.c (mon.1) 364 : audit [DBG] from='client.? 172.21.15.40:0/2503010287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:25.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:25 smithi040 bash[35794]: cluster 2024-02-10T09:00:24.403336+0000 mgr.y (mgr.14883) 92 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:25.736 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:25 smithi040 bash[38951]: cluster 2024-02-10T09:00:24.403336+0000 mgr.y (mgr.14883) 92 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:25.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:25 smithi145 bash[35820]: cluster 2024-02-10T09:00:24.403336+0000 mgr.y (mgr.14883) 92 : cluster [DBG] pgmap v56: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:26.330 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:00:26.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:26 smithi040 bash[35794]: audit 2024-02-10T09:00:24.983406+0000 mgr.y (mgr.14883) 93 : audit [DBG] from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:26.654 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:26 smithi040 bash[38951]: audit 2024-02-10T09:00:24.983406+0000 mgr.y (mgr.14883) 93 : audit [DBG] from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:26.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:26 smithi145 bash[35820]: audit 2024-02-10T09:00:24.983406+0000 mgr.y (mgr.14883) 93 : audit [DBG] from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:26.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '"'"'{print $2}'"'"')' 2024-02-10T09:00:27.634 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:27 smithi040 bash[38951]: cluster 2024-02-10T09:00:26.403645+0000 mgr.y (mgr.14883) 94 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:27.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:27 smithi040 bash[35794]: cluster 2024-02-10T09:00:26.403645+0000 mgr.y (mgr.14883) 94 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:27.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:27 smithi145 bash[35820]: cluster 2024-02-10T09:00:26.403645+0000 mgr.y (mgr.14883) 94 : cluster [DBG] pgmap v57: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: cluster 2024-02-10T09:00:28.404216+0000 mgr.y (mgr.14883) 95 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.942584+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.943003+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.943343+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.943650+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.943935+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.944228+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.945893+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.946178+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.946466+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.946747+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:29 smithi145 bash[35820]: audit 2024-02-10T09:00:28.947015+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: cluster 2024-02-10T09:00:28.404216+0000 mgr.y (mgr.14883) 95 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:29.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.942584+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.943003+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.943343+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.943650+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.943935+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.944228+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.945893+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.946178+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.946466+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.946747+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[38951]: audit 2024-02-10T09:00:28.947015+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: cluster 2024-02-10T09:00:28.404216+0000 mgr.y (mgr.14883) 95 : cluster [DBG] pgmap v58: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.942584+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.943003+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.943343+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.943650+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.943935+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.944228+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.945893+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.946178+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.946466+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.946747+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:29.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:29 smithi040 bash[35794]: audit 2024-02-10T09:00:28.947015+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:30.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:30 smithi040 bash[35794]: audit 2024-02-10T09:00:28.940684+0000 mgr.y (mgr.14883) 96 : audit [DBG] from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:30.593 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:30 smithi040 bash[35794]: audit 2024-02-10T09:00:29.276917+0000 mgr.y (mgr.14883) 97 : audit [DBG] from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mon", "hosts": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:30.593 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:30 smithi040 bash[38951]: audit 2024-02-10T09:00:28.940684+0000 mgr.y (mgr.14883) 96 : audit [DBG] from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:30.594 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:30 smithi040 bash[38951]: audit 2024-02-10T09:00:29.276917+0000 mgr.y (mgr.14883) 97 : audit [DBG] from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mon", "hosts": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:30 smithi145 bash[35820]: audit 2024-02-10T09:00:28.940684+0000 mgr.y (mgr.14883) 96 : audit [DBG] from='client.24961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:30.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:30 smithi145 bash[35820]: audit 2024-02-10T09:00:29.276917+0000 mgr.y (mgr.14883) 97 : audit [DBG] from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mon", "hosts": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:31.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:00:31.551 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: cluster 2024-02-10T09:00:30.405148+0000 mgr.y (mgr.14883) 98 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:31.551 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: audit 2024-02-10T09:00:30.615544+0000 mon.c (mon.1) 376 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:31.551 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: audit 2024-02-10T09:00:30.615935+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:31.551 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: audit 2024-02-10T09:00:30.619169+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: audit 2024-02-10T09:00:30.635997+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: audit 2024-02-10T09:00:30.636334+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[35794]: audit 2024-02-10T09:00:30.641767+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: cluster 2024-02-10T09:00:30.405148+0000 mgr.y (mgr.14883) 98 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: audit 2024-02-10T09:00:30.615544+0000 mon.c (mon.1) 376 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: audit 2024-02-10T09:00:30.615935+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: audit 2024-02-10T09:00:30.619169+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: audit 2024-02-10T09:00:30.635997+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: audit 2024-02-10T09:00:30.636334+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:31.552 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:31 smithi040 bash[38951]: audit 2024-02-10T09:00:30.641767+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: cluster 2024-02-10T09:00:30.405148+0000 mgr.y (mgr.14883) 98 : cluster [DBG] pgmap v59: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: audit 2024-02-10T09:00:30.615544+0000 mon.c (mon.1) 376 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: audit 2024-02-10T09:00:30.615935+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: audit 2024-02-10T09:00:30.619169+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:00:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: audit 2024-02-10T09:00:30.635997+0000 mon.c (mon.1) 377 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:31.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: audit 2024-02-10T09:00:30.636334+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:31.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:31 smithi145 bash[35820]: audit 2024-02-10T09:00:30.641767+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:32.768 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:32 smithi040 bash[38951]: cephadm 2024-02-10T09:00:30.614807+0000 mgr.y (mgr.14883) 99 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:32.768 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:32 smithi040 bash[38951]: cephadm 2024-02-10T09:00:30.648314+0000 mgr.y (mgr.14883) 100 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:32.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:32 smithi040 bash[35794]: cephadm 2024-02-10T09:00:30.614807+0000 mgr.y (mgr.14883) 99 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:32.769 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:32 smithi040 bash[35794]: cephadm 2024-02-10T09:00:30.648314+0000 mgr.y (mgr.14883) 100 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:32 smithi145 bash[35820]: cephadm 2024-02-10T09:00:30.614807+0000 mgr.y (mgr.14883) 99 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:32.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:32 smithi145 bash[35820]: cephadm 2024-02-10T09:00:30.648314+0000 mgr.y (mgr.14883) 100 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:00:33.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: cluster 2024-02-10T09:00:32.405606+0000 mgr.y (mgr.14883) 101 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:33.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.582236+0000 mon.c (mon.1) 378 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:33.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.582533+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.587644+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: cephadm 2024-02-10T09:00:32.588260+0000 mgr.y (mgr.14883) 102 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: cephadm 2024-02-10T09:00:32.588315+0000 mgr.y (mgr.14883) 103 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.589165+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.590028+0000 mon.c (mon.1) 380 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.590313+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: cluster 2024-02-10T09:00:32.405606+0000 mgr.y (mgr.14883) 101 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.582236+0000 mon.c (mon.1) 378 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.582533+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:33.636 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.587644+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: cephadm 2024-02-10T09:00:32.588260+0000 mgr.y (mgr.14883) 102 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: cephadm 2024-02-10T09:00:32.588315+0000 mgr.y (mgr.14883) 103 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.589165+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.590028+0000 mon.c (mon.1) 380 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.590313+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.596296+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.597862+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: cephadm 2024-02-10T09:00:32.598419+0000 mgr.y (mgr.14883) 104 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.598594+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.598808+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:00:33.637 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.604741+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]': finished 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.605776+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: audit 2024-02-10T09:00:32.606396+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[35794]: cephadm 2024-02-10T09:00:32.606803+0000 mgr.y (mgr.14883) 105 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.596296+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.597862+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: cephadm 2024-02-10T09:00:32.598419+0000 mgr.y (mgr.14883) 104 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.598594+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.598808+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.604741+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]': finished 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.605776+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: audit 2024-02-10T09:00:32.606396+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-10T09:00:33.638 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:33 smithi040 bash[38951]: cephadm 2024-02-10T09:00:32.606803+0000 mgr.y (mgr.14883) 105 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-10T09:00:33.688 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: cluster 2024-02-10T09:00:32.405606+0000 mgr.y (mgr.14883) 101 : cluster [DBG] pgmap v60: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:33.688 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.582236+0000 mon.c (mon.1) 378 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:33.688 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.582533+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:00:33.688 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.587644+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi145\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:00:33.688 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: cephadm 2024-02-10T09:00:32.588260+0000 mgr.y (mgr.14883) 102 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:00:33.688 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: cephadm 2024-02-10T09:00:32.588315+0000 mgr.y (mgr.14883) 103 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.589165+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.590028+0000 mon.c (mon.1) 380 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.590313+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.596296+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.597862+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: cephadm 2024-02-10T09:00:32.598419+0000 mgr.y (mgr.14883) 104 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.598594+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.598808+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.604741+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]': finished 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.605776+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: audit 2024-02-10T09:00:32.606396+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-10T09:00:33.689 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:33 smithi145 bash[35820]: cephadm 2024-02-10T09:00:32.606803+0000 mgr.y (mgr.14883) 105 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-10T09:00:34.099 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:00:34.677 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: cephadm 2024-02-10T09:00:33.993649+0000 mgr.y (mgr.14883) 106 : cephadm [INF] Upgrade: Updating mon.b 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:33.994021+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:33.994408+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:33.998657+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]': finished 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:33.999560+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:34.000123+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:34.000666+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: cephadm 2024-02-10T09:00:34.001199+0000 mgr.y (mgr.14883) 107 : cephadm [INF] Deploying daemon mon.b on smithi145 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:34.001523+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:34.087487+0000 mgr.y (mgr.14883) 108 : audit [DBG] from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: cluster 2024-02-10T09:00:34.406185+0000 mgr.y (mgr.14883) 109 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:34.678 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:34 smithi145 bash[35820]: audit 2024-02-10T09:00:34.408268+0000 mgr.y (mgr.14883) 110 : audit [DBG] from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (50s) 46s ago 24m 13.6M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (30s) 24s ago 23m 22.7M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (95s) 24s ago 27m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (11m) 46s ago 29m 421M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (29m) 46s ago 29m 241M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (27m) 24s ago 27m 188M 2048M 15.2.0 204a01f9b0b6 250ee6899adc 2024-02-10T09:00:34.732 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (28m) 46s ago 28m 189M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (83s) 46s ago 24m 12.8M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (75s) 24s ago 24m 13.6M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (27m) 46s ago 27m 48.9M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (26m) 46s ago 26m 46.1M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (26m) 46s ago 26m 45.2M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (26m) 46s ago 26m 50.3M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (26m) 24s ago 26m 49.2M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (25m) 24s ago 25m 45.4M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (25m) 24s ago 25m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (25m) 24s ago 25m 46.4M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (63s) 24s ago 24m 46.9M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (22m) 46s ago 22m 39.2M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:00:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (22m) 24s ago 22m 38.7M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:00:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: cephadm 2024-02-10T09:00:33.993649+0000 mgr.y (mgr.14883) 106 : cephadm [INF] Upgrade: Updating mon.b 2024-02-10T09:00:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:33.994021+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]: dispatch 2024-02-10T09:00:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:33.994408+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]: dispatch 2024-02-10T09:00:34.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:33.998657+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]': finished 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:33.999560+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:34.000123+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:34.000666+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: cephadm 2024-02-10T09:00:34.001199+0000 mgr.y (mgr.14883) 107 : cephadm [INF] Deploying daemon mon.b on smithi145 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:34.001523+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:34.087487+0000 mgr.y (mgr.14883) 108 : audit [DBG] from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: cluster 2024-02-10T09:00:34.406185+0000 mgr.y (mgr.14883) 109 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[35794]: audit 2024-02-10T09:00:34.408268+0000 mgr.y (mgr.14883) 110 : audit [DBG] from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: cephadm 2024-02-10T09:00:33.993649+0000 mgr.y (mgr.14883) 106 : cephadm [INF] Upgrade: Updating mon.b 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:33.994021+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]: dispatch 2024-02-10T09:00:34.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:33.994408+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]: dispatch 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:33.998657+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.b"}]': finished 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:33.999560+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:34.000123+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:34.000666+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: cephadm 2024-02-10T09:00:34.001199+0000 mgr.y (mgr.14883) 107 : cephadm [INF] Deploying daemon mon.b on smithi145 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:34.001523+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:34.087487+0000 mgr.y (mgr.14883) 108 : audit [DBG] from='client.24973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: cluster 2024-02-10T09:00:34.406185+0000 mgr.y (mgr.14883) 109 : cluster [DBG] pgmap v61: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:34.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:34 smithi040 bash[38951]: audit 2024-02-10T09:00:34.408268+0000 mgr.y (mgr.14883) 110 : audit [DBG] from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T09:00:35.114 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:00:35.115 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi145", 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "0/1 daemons upgraded", 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading mon daemons", 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:00:35.434 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:00:35.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 systemd[1]: Stopping Ceph mon.b for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:00:35.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.720659+0000 mgr.y (mgr.14883) 111 : audit [DBG] from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:35.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.722586+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.722993+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.723315+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.723648+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.723973+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.724281+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.725947+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.726241+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.726558+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.726874+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:34.727198+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:35.114292+0000 mon.c (mon.1) 401 : audit [DBG] from='client.? 172.21.15.40:0/3299037096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: audit 2024-02-10T09:00:35.433825+0000 mgr.y (mgr.14883) 112 : audit [DBG] from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: debug 2024-02-10T09:00:35.599+0000 7fcb046af700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:00:35.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:35 smithi145 bash[35820]: debug 2024-02-10T09:00:35.599+0000 7fcb046af700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-02-10T09:00:35.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.720659+0000 mgr.y (mgr.14883) 111 : audit [DBG] from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.722586+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.722993+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.723315+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.723648+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.723973+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.724281+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.725947+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.726241+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.726558+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.726874+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:34.727198+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:35.114292+0000 mon.c (mon.1) 401 : audit [DBG] from='client.? 172.21.15.40:0/3299037096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[35794]: audit 2024-02-10T09:00:35.433825+0000 mgr.y (mgr.14883) 112 : audit [DBG] from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.720659+0000 mgr.y (mgr.14883) 111 : audit [DBG] from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.722586+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.722993+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.723315+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.723648+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.723973+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.724281+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.725947+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.726241+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.726558+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.726874+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:34.727198+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:35.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:35.114292+0000 mon.c (mon.1) 401 : audit [DBG] from='client.? 172.21.15.40:0/3299037096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:35.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:35 smithi040 bash[38951]: audit 2024-02-10T09:00:35.433825+0000 mgr.y (mgr.14883) 112 : audit [DBG] from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:36.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:36 smithi145 bash[60347]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.b 2024-02-10T09:00:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:36 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.b.service: Succeeded. 2024-02-10T09:00:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:36 smithi145 systemd[1]: Stopped Ceph mon.b for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:00:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:36 smithi145 systemd[1]: Starting Ceph mon.b for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:00:37.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.366+0000 7fd5cdeb3880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T09:00:37.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.366+0000 7fd5cdeb3880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-10T09:00:37.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.366+0000 7fd5cdeb3880 0 pidfile_write: ignore empty --pid-file 2024-02-10T09:00:37.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.370+0000 7fd5cdeb3880 0 load: jerasure load: lrc load: isa 2024-02-10T09:00:37.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T09:00:37.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: DB SUMMARY 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: CURRENT file: CURRENT 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 3071 Bytes 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000071.sst 000072.sst 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000069.log size: 2406901 ; 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.create_if_missing: 0 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.env: 0x56172695f080 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.fs: Posix File System 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.info_log: 0x561728b82260 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T09:00:37.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.statistics: (nil) 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.use_fsync: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T09:00:37.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.db_log_dir: 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T09:00:37.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.write_buffer_manager: 0x561729874390 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T09:00:37.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.unordered_write: 0 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T09:00:37.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.row_cache: None 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.wal_filter: None 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T09:00:37.792 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T09:00:37.793 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_open_files: -1 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Compression algorithms supported: 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kZSTD supported: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T09:00:37.794 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.merge_operator: 2024-02-10T09:00:37.795 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_filter: None 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561728b27d28) 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cache_index_and_filter_blocks: 1 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: pin_top_level_index_and_filter: 1 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: index_type: 0 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: data_block_index_type: 0 2024-02-10T09:00:37.796 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: index_shortening: 1 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: hash_index_allow_collision: 1 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: checksum: 1 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: no_block_cache: 0 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_cache: 0x561728b5cf10 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_cache_name: BinnedLRUCache 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_cache_options: 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: capacity : 536870912 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: num_shard_bits : 4 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: strict_capacity_limit : 0 2024-02-10T09:00:37.797 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: high_pri_pool_ratio: 0.000 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_cache_compressed: (nil) 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: persistent_cache: (nil) 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_size: 4096 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_size_deviation: 10 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_restart_interval: 16 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: index_block_restart_interval: 1 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: metadata_block_size: 4096 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: partition_filters: 0 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: use_delta_encoding: 1 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: whole_key_filtering: 1 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: verify_compression: 0 2024-02-10T09:00:37.798 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: read_amp_bytes_per_bit: 0 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: format_version: 2 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: enable_index_compression: 1 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: block_align: 0 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression: NoCompression 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.num_levels: 7 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T09:00:37.799 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T09:00:37.800 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T09:00:37.801 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T09:00:37.802 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T09:00:37.803 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.ttl: 2592000 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.371+0000 7fd5cdeb3880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.372+0000 7fd5cdeb3880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 74, last_sequence is 25215, log_number is 69,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.372+0000 7fd5cdeb3880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 69 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.372+0000 7fd5cdeb3880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555637373769, "job": 1, "event": "recovery_started", "log_files": [69]} 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.372+0000 7fd5cdeb3880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #69 mode 2 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.374+0000 7fd5cdeb3880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.376+0000 7fd5cdeb3880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555637378239, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 74, "file_size": 1601090, "table_properties": {"data_size": 1597738, "index_size": 2214, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 325, "raw_key_size": 2708, "raw_average_key_size": 22, "raw_value_size": 1594198, "raw_average_value_size": 13284, "num_data_blocks": 70, "num_entries": 120, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707555637, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-10T09:00:37.804 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.376+0000 7fd5cdeb3880 4 rocksdb: [version_set.cc:3826] Creating manifest 75 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.379+0000 7fd5cdeb3880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555637380996, "job": 1, "event": "recovery_finished"} 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.380+0000 7fd5cdeb3880 4 rocksdb: DB pointer 0x561728c25800 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.380+0000 7fd5b4ca4700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.380+0000 7fd5b4ca4700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** DB Stats ** 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.805 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** Compaction Stats [default] ** 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: L0 1/0 1.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: L6 2/0 95.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Sum 3/0 97.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** Compaction Stats [default] ** 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:00:37.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Flush(GB): cumulative 0.001, interval 0.001 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Cumulative compaction: 0.00 GB write, 170.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Interval compaction: 0.00 GB write, 170.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T09:00:37.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** Compaction Stats [default] ** 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: L0 1/0 1.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: L6 2/0 95.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Sum 3/0 97.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** Compaction Stats [default] ** 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 605.9 0.00 0.00 1 0.003 0 0 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:00:37.808 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Flush(GB): cumulative 0.001, interval 0.000 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Cumulative compaction: 0.00 GB write, 169.73 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.381+0000 7fd5cdeb3880 0 starting mon.b rank 2 at public addrs [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] at bind addrs [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.381+0000 7fd5cdeb3880 1 mon.b@-1(???) e3 preinit fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 0 mon.b@-1(???).mds e1 new map 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 0 mon.b@-1(???).mds e1 print_map 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: e1 2024-02-10T09:00:37.809 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: legacy client fscid: -1 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: No filesystems configured 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 0 mon.b@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 0 mon.b@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.720659+0000 mgr.y (mgr.14883) 111 : audit [DBG] from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.722586+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:37.810 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.722993+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.723315+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.723648+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.723973+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.724281+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.725947+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.726241+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.726558+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.726874+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:34.727198+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:35.114292+0000 mon.c (mon.1) 401 : audit [DBG] from='client.? 172.21.15.40:0/3299037096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:37.811 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:35.433825+0000 mgr.y (mgr.14883) 112 : audit [DBG] from='client.24997 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:00:37.812 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:00:37.382+0000 7fd5cdeb3880 1 mon.b@-1(???).paxosservice(auth 1..26) refresh upgraded, format 0 -> 3 2024-02-10T09:00:37.812 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 bash[60534]: 61b9d8dce82b3e43aa4f7276a60f1953a63b718dcdba9dd23686f06a5ac66df0 2024-02-10T09:00:37.812 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:37 smithi145 systemd[1]: Started Ceph mon.b for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:00:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:36.406643+0000 mgr.y (mgr.14883) 113 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:38.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:36.406643+0000 mgr.y (mgr.14883) 113 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.459823+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.590667+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T09:00:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.591306+0000 mon.c (mon.1) 403 : cluster [INF] mon.c calling monitor election 2024-02-10T09:00:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.459823+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.590667+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T09:00:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.591306+0000 mon.c (mon.1) 403 : cluster [INF] mon.c calling monitor election 2024-02-10T09:00:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.591437+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.591437+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.591756+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.591815+0000 mon.a (mon.0) 952 : cluster [INF] mon.a calling monitor election 2024-02-10T09:00:38.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.604681+0000 mon.a (mon.0) 953 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.591756+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.591815+0000 mon.a (mon.0) 952 : cluster [INF] mon.a calling monitor election 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.604681+0000 mon.a (mon.0) 953 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.605513+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14883 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.608996+0000 mon.a (mon.0) 955 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.609082+0000 mon.a (mon.0) 956 : cluster [DBG] fsmap 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.609145+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:00:38.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.609817+0000 mon.a (mon.0) 958 : cluster [DBG] mgrmap e31: y(active, since 2m), standbys: x 2024-02-10T09:00:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.605513+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14883 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.608996+0000 mon.a (mon.0) 955 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T09:00:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.609082+0000 mon.a (mon.0) 956 : cluster [DBG] fsmap 2024-02-10T09:00:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.609145+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:00:38.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.609817+0000 mon.a (mon.0) 958 : cluster [DBG] mgrmap e31: y(active, since 2m), standbys: x 2024-02-10T09:00:38.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.610457+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.610457+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.623354+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14883 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:37.623497+0000 mon.a (mon.0) 961 : cluster [INF] overall HEALTH_OK 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.623354+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14883 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:37.623497+0000 mon.a (mon.0) 961 : cluster [INF] overall HEALTH_OK 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.626615+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:37.627225+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: cluster 2024-02-10T09:00:38.407149+0000 mgr.y (mgr.14883) 114 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.422432+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.422726+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.422846+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.422986+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.423426+0000 mon.c (mon.1) 408 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.423464+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.423937+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[35794]: audit 2024-02-10T09:00:38.424264+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.626615+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:37.627225+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: cluster 2024-02-10T09:00:38.407149+0000 mgr.y (mgr.14883) 114 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.422432+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.422726+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.934 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.422846+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T09:00:38.935 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.422986+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.935 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.423426+0000 mon.c (mon.1) 408 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:00:38.935 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.423464+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.935 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.423937+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.935 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:38 smithi040 bash[38951]: audit 2024-02-10T09:00:38.424264+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:00:38.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:36.406643+0000 mgr.y (mgr.14883) 113 : cluster [DBG] pgmap v62: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:38.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.459823+0000 mon.c (mon.1) 402 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \" 2024-02-10T09:00:38.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.590667+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.591306+0000 mon.c (mon.1) 403 : cluster [INF] mon.c calling monitor election 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.591437+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interf 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: aces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.591756+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.591815+0000 mon.a (mon.0) 952 : cluster [INF] mon.a calling monitor election 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.604681+0000 mon.a (mon.0) 953 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.605513+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14883 ' entity='' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: \": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.941 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.608996+0000 mon.a (mon.0) 955 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.609082+0000 mon.a (mon.0) 956 : cluster [DBG] fsmap 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.609145+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.609817+0000 mon.a (mon.0) 958 : cluster [DBG] mgrmap e31: y(active, since 2m), standbys: x 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.610457+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.623354+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14883 ' entity='' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_re 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: asons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:37.623497+0000 mon.a (mon.0) 961 : cluster [INF] overall HEALTH_OK 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.626615+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 404435763, \"cpu_percentage\": \"10.32%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:09.773340Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51589939, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773435Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773522Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47615836, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773605Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48748298, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.773686Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49241128, \"cpu_percentage\": \"1.08%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773765Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\", \"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\"], \"memory_usage\": 14323548, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773844Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 23855104, \"cpu_percentage\": \"47.18%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:09.773922Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40653291, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:09.774000Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"reject 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ed_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:37.627225+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:38.407149+0000 mgr.y (mgr.14883) 114 : cluster [DBG] pgmap v63: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.422432+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T09:00:38.942 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.422726+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.422846+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-10T09:00:38.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.422986+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.423426+0000 mon.c (mon.1) 408 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:00:38.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.423464+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.423937+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-10T09:00:38.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:38.424264+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:00:41.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:40.407853+0000 mgr.y (mgr.14883) 115 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:41.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:41 smithi040 bash[35794]: cluster 2024-02-10T09:00:40.407853+0000 mgr.y (mgr.14883) 115 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:41.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:41 smithi040 bash[38951]: cluster 2024-02-10T09:00:40.407853+0000 mgr.y (mgr.14883) 115 : cluster [DBG] pgmap v64: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:42.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:00:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:00:42.389+0000 7fa67eb6c700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-10T09:00:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.162781+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.162781+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:42.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.163432+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.163432+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.167418+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.169459+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.169762+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.172849+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.178847+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.179897+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.180250+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.181768+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.183368+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.167418+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.169459+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.169762+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.172849+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.178847+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.179897+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.180250+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.181768+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.183368+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.184333+0000 mon.c (mon.1) 415 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.184644+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.189213+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]': finished 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.191119+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.192089+0000 mon.c (mon.1) 417 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.192370+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.196321+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]': finished 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.197926+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.198828+0000 mon.c (mon.1) 419 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.199133+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.203394+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.204712+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.205574+0000 mon.c (mon.1) 421 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.205869+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.184333+0000 mon.c (mon.1) 415 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.184644+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.189213+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]': finished 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.191119+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.192089+0000 mon.c (mon.1) 417 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.192370+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.196321+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]': finished 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.197926+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.198828+0000 mon.c (mon.1) 419 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.199133+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.203394+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.204712+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.205574+0000 mon.c (mon.1) 421 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.205869+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.210140+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]': finished 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.211631+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.211967+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.215551+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.217408+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.218293+0000 mon.c (mon.1) 424 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.218585+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.222780+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]': finished 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.224095+0000 mon.c (mon.1) 425 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.224969+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.225248+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.229088+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]': finished 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.230695+0000 mon.c (mon.1) 427 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.231605+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.231891+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.210140+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]': finished 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.211631+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.211967+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.215551+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.217408+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.218293+0000 mon.c (mon.1) 424 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.218585+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.222780+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]': finished 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.224095+0000 mon.c (mon.1) 425 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.224969+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.225248+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.229088+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]': finished 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.230695+0000 mon.c (mon.1) 427 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.231605+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.231891+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.232667+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.232897+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.234050+0000 mon.c (mon.1) 430 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.234840+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.235066+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.235824+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.236093+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.237270+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.238076+0000 mon.c (mon.1) 434 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.238343+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.239089+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.239337+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.240462+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.241290+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.241536+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.242304+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.232667+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.232897+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.234050+0000 mon.c (mon.1) 430 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.234840+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.235066+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.235824+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.236093+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.237270+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.238076+0000 mon.c (mon.1) 434 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.238343+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.239089+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.239337+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.240462+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.241290+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.241536+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.242304+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.242558+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.243326+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.243554+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.244214+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.244443+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.248366+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.249426+0000 mon.c (mon.1) 441 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.249662+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.253075+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.254357+0000 mon.c (mon.1) 442 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.254589+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.258862+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.260010+0000 mon.c (mon.1) 443 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.260316+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.260998+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.261278+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:42.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.264783+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.242558+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.243326+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.243554+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.244214+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.244443+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.248366+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.249426+0000 mon.c (mon.1) 441 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.249662+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.253075+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.254357+0000 mon.c (mon.1) 442 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.254589+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.258862+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.260010+0000 mon.c (mon.1) 443 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:42.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.260316+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.260998+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.261278+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.264783+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.268357+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.268624+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.269303+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.269547+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.275430+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.278815+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.279097+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.279745+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.279996+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.285755+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:00:42.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.289102+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.289377+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.294950+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.298307+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.298580+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.299216+0000 mon.c (mon.1) 451 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.299463+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.268357+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.268624+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.269303+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.269547+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.275430+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:42.691 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.278815+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.279097+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.279745+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.279996+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.285755+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.289102+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.289377+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.294950+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.298307+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.298580+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.299216+0000 mon.c (mon.1) 451 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.299463+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.300106+0000 mon.c (mon.1) 452 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.300354+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.300979+0000 mon.c (mon.1) 453 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.301217+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.301828+0000 mon.c (mon.1) 454 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.302077+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.307910+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.311337+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.311575+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.316335+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.320329+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.320573+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.325502+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.334086+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.334333+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[38951]: audit 2024-02-10T09:00:42.339483+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.300106+0000 mon.c (mon.1) 452 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.300354+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.300979+0000 mon.c (mon.1) 453 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.301217+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.301828+0000 mon.c (mon.1) 454 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.302077+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.307910+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.311337+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.311575+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.316335+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:00:42.694 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.320329+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.320573+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.325502+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.334086+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.334333+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.695 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:42 smithi040 bash[35794]: audit 2024-02-10T09:00:42.339483+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.162781+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": 2024-02-10T09:00:42.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:42.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.163432+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\" 2024-02-10T09:00:42.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: : \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:00:42.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.167418+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 20719861, \"cpu_percentage\": \"12.22%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160246Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 405379481, \"cpu_percentage\": \"7.11%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:00:42.160433Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51621396, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160526Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160610Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160690Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 49094328, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.160770Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 49534730, \"cpu_percentage\": \"0.72%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160851Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 14837350, \"cpu_percentage\": \"0.67%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.160929Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 48507125, \"cpu_percentage\": \"2.11%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:00:42.161009Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\ 2024-02-10T09:00:42.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: ": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40946892, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:00:42.161103Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:00:42.161260Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.169459+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.169762+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.172849+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.178847+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.179897+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.180250+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.181768+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.183368+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.184333+0000 mon.c (mon.1) 415 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.184644+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.189213+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.crash"}]': finished 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.191119+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.192089+0000 mon.c (mon.1) 417 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.192370+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]: dispatch 2024-02-10T09:00:42.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.196321+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mds"}]': finished 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.197926+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.198828+0000 mon.c (mon.1) 419 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.199133+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.203394+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.204712+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.205574+0000 mon.c (mon.1) 421 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.205869+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.210140+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]': finished 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.211631+0000 mon.c (mon.1) 422 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.211967+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.215551+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.217408+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.218293+0000 mon.c (mon.1) 424 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.218585+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.222780+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.iscsi"}]': finished 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.224095+0000 mon.c (mon.1) 425 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.224969+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.225248+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.229088+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "client.nfs"}]': finished 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.230695+0000 mon.c (mon.1) 427 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.231605+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.231891+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.232667+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.232897+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.234050+0000 mon.c (mon.1) 430 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.234840+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.235066+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.235824+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.236093+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.237270+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.238076+0000 mon.c (mon.1) 434 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.238343+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.239089+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.239337+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.240462+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.241290+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.241536+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.242304+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.242558+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.243326+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.243554+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "global"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.244214+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.244443+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.248366+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.249426+0000 mon.c (mon.1) 441 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.249662+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.253075+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.254357+0000 mon.c (mon.1) 442 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.254589+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.258862+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.260010+0000 mon.c (mon.1) 443 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.260316+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.260998+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.261278+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.264783+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.268357+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.268624+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.269303+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.269547+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.275430+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.278815+0000 mon.c (mon.1) 447 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.279097+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.279745+0000 mon.c (mon.1) 448 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.279996+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.285755+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.289102+0000 mon.c (mon.1) 449 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.289377+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.294950+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.298307+0000 mon.c (mon.1) 450 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.298580+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.299216+0000 mon.c (mon.1) 451 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.299463+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.300106+0000 mon.c (mon.1) 452 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.300354+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.300979+0000 mon.c (mon.1) 453 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.301217+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:00:42.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.301828+0000 mon.c (mon.1) 454 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.302077+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.307910+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.311337+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.311575+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.316335+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.320329+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.320573+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.325502+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.334086+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.334333+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:00:42.791 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:42.339483+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:00:43.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.184080+0000 mgr.y (mgr.14883) 116 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.191838+0000 mgr.y (mgr.14883) 117 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.198609+0000 mgr.y (mgr.14883) 118 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.205353+0000 mgr.y (mgr.14883) 119 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.218089+0000 mgr.y (mgr.14883) 120 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.224756+0000 mgr.y (mgr.14883) 121 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.231398+0000 mgr.y (mgr.14883) 122 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.234654+0000 mgr.y (mgr.14883) 123 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.237883+0000 mgr.y (mgr.14883) 124 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.241094+0000 mgr.y (mgr.14883) 125 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.243144+0000 mgr.y (mgr.14883) 126 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:00:42.310978+0000 mgr.y (mgr.14883) 127 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:00:43.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:42.408148+0000 mgr.y (mgr.14883) 128 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:43.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.184080+0000 mgr.y (mgr.14883) 116 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.191838+0000 mgr.y (mgr.14883) 117 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.198609+0000 mgr.y (mgr.14883) 118 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.205353+0000 mgr.y (mgr.14883) 119 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.218089+0000 mgr.y (mgr.14883) 120 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.224756+0000 mgr.y (mgr.14883) 121 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.231398+0000 mgr.y (mgr.14883) 122 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.234654+0000 mgr.y (mgr.14883) 123 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.237883+0000 mgr.y (mgr.14883) 124 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.241094+0000 mgr.y (mgr.14883) 125 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.243144+0000 mgr.y (mgr.14883) 126 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cephadm 2024-02-10T09:00:42.310978+0000 mgr.y (mgr.14883) 127 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[38951]: cluster 2024-02-10T09:00:42.408148+0000 mgr.y (mgr.14883) 128 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.184080+0000 mgr.y (mgr.14883) 116 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.191838+0000 mgr.y (mgr.14883) 117 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.198609+0000 mgr.y (mgr.14883) 118 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.205353+0000 mgr.y (mgr.14883) 119 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.218089+0000 mgr.y (mgr.14883) 120 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.224756+0000 mgr.y (mgr.14883) 121 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.231398+0000 mgr.y (mgr.14883) 122 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.234654+0000 mgr.y (mgr.14883) 123 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.237883+0000 mgr.y (mgr.14883) 124 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.241094+0000 mgr.y (mgr.14883) 125 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.243144+0000 mgr.y (mgr.14883) 126 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cephadm 2024-02-10T09:00:42.310978+0000 mgr.y (mgr.14883) 127 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:00:43.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:43 smithi040 bash[35794]: cluster 2024-02-10T09:00:42.408148+0000 mgr.y (mgr.14883) 128 : cluster [DBG] pgmap v65: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:43.823292+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:43.823724+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:44.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:00:43.827777+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T09:00:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:44 smithi040 bash[35794]: audit 2024-02-10T09:00:43.823292+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:44.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:44 smithi040 bash[35794]: audit 2024-02-10T09:00:43.823724+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:44.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:44 smithi040 bash[35794]: audit 2024-02-10T09:00:43.827777+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T09:00:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:44 smithi040 bash[38951]: audit 2024-02-10T09:00:43.823292+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:44 smithi040 bash[38951]: audit 2024-02-10T09:00:43.823724+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-10T09:00:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:44 smithi040 bash[38951]: audit 2024-02-10T09:00:43.827777+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"302f4d88-1460-4f96-9d0c-f61bfae23200\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1707554092.1635134, \"finished_at\": 1707555518.5627043, \"add_to_ceph_s:\": 1707554079.097497}, {\"id\": \"fb5acc5e-adb2-4495-bab9-6fbc6fb03e42\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1707554111.4692633, \"finished_at\": 1707555518.5627124, \"add_to_ceph_s:\": 1707554100.2559822}, {\"id\": \"a4c95017-a3f7-4682-9298-52fcd2843629\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1707554130.9006414, \"finished_at\": 1707555518.562714, \"add_to_ceph_s:\": 1707554118.4248374}, {\"id\": \"5075875a-6074-4c90-b8ee-09648c6e9d53\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1707554147.10626, \"finished_at\": 1707555518.5627153, \"add_to_ceph_s:\": 1707554137.2433784}, {\"id\": \"4377aa7f-a1c6-43d3-b569-a06460591ec9\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555524.7379265, \"finished_at\": 1707555610.150849, \"add_to_ceph_s:\": true}, {\"id\": \"a0abd600-ce8a-424a-8035-46c149f7369b\", \"message\": \"Upgrade to 16.2.14-521-g0e714d9a\", \"refs\": [], \"started_at\": 1707555630.6148837, \"finished_at\": 1707555642.3111627, \"add_to_ceph_s:\": true}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-10T09:00:45.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:44.408768+0000 mgr.y (mgr.14883) 129 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:45.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:45 smithi040 bash[35794]: cluster 2024-02-10T09:00:44.408768+0000 mgr.y (mgr.14883) 129 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:45.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:45 smithi040 bash[38951]: cluster 2024-02-10T09:00:44.408768+0000 mgr.y (mgr.14883) 129 : cluster [DBG] pgmap v66: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:47.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:46.409273+0000 mgr.y (mgr.14883) 130 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:47.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:47 smithi040 bash[35794]: cluster 2024-02-10T09:00:46.409273+0000 mgr.y (mgr.14883) 130 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:47.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:47 smithi040 bash[38951]: cluster 2024-02-10T09:00:46.409273+0000 mgr.y (mgr.14883) 130 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:49.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:48.409772+0000 mgr.y (mgr.14883) 131 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:49.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:49 smithi040 bash[35794]: cluster 2024-02-10T09:00:48.409772+0000 mgr.y (mgr.14883) 131 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:49.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:49 smithi040 bash[38951]: cluster 2024-02-10T09:00:48.409772+0000 mgr.y (mgr.14883) 131 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:51.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:50.410721+0000 mgr.y (mgr.14883) 132 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:51.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:51 smithi040 bash[35794]: cluster 2024-02-10T09:00:50.410721+0000 mgr.y (mgr.14883) 132 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:51.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:51 smithi040 bash[38951]: cluster 2024-02-10T09:00:50.410721+0000 mgr.y (mgr.14883) 132 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:53.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:52.411189+0000 mgr.y (mgr.14883) 133 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:53.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:53 smithi040 bash[35794]: cluster 2024-02-10T09:00:52.411189+0000 mgr.y (mgr.14883) 133 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:53.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:53 smithi040 bash[38951]: cluster 2024-02-10T09:00:52.411189+0000 mgr.y (mgr.14883) 133 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:55.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:54.412037+0000 mgr.y (mgr.14883) 134 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:55 smithi040 bash[35794]: cluster 2024-02-10T09:00:54.412037+0000 mgr.y (mgr.14883) 134 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:55.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:55 smithi040 bash[38951]: cluster 2024-02-10T09:00:54.412037+0000 mgr.y (mgr.14883) 134 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:57.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:56.412449+0000 mgr.y (mgr.14883) 135 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:57.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:57 smithi040 bash[35794]: cluster 2024-02-10T09:00:56.412449+0000 mgr.y (mgr.14883) 135 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:57.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:57 smithi040 bash[38951]: cluster 2024-02-10T09:00:56.412449+0000 mgr.y (mgr.14883) 135 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:59.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:00:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:00:58.412916+0000 mgr.y (mgr.14883) 136 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:59.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:00:59 smithi040 bash[35794]: cluster 2024-02-10T09:00:58.412916+0000 mgr.y (mgr.14883) 136 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:00:59.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:00:59 smithi040 bash[38951]: cluster 2024-02-10T09:00:58.412916+0000 mgr.y (mgr.14883) 136 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:00.413724+0000 mgr.y (mgr.14883) 137 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:01.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:01 smithi040 bash[35794]: cluster 2024-02-10T09:01:00.413724+0000 mgr.y (mgr.14883) 137 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:01.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:01 smithi040 bash[38951]: cluster 2024-02-10T09:01:00.413724+0000 mgr.y (mgr.14883) 137 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:03.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:02.414192+0000 mgr.y (mgr.14883) 138 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:03.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:03 smithi040 bash[35794]: cluster 2024-02-10T09:01:02.414192+0000 mgr.y (mgr.14883) 138 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:03.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:03 smithi040 bash[38951]: cluster 2024-02-10T09:01:02.414192+0000 mgr.y (mgr.14883) 138 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:05.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:04.415004+0000 mgr.y (mgr.14883) 139 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:05.809 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:05 smithi040 bash[35794]: cluster 2024-02-10T09:01:04.415004+0000 mgr.y (mgr.14883) 139 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:05.809 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:05 smithi040 bash[38951]: cluster 2024-02-10T09:01:04.415004+0000 mgr.y (mgr.14883) 139 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:06.394 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:01:07.622 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:07 smithi040 bash[35794]: audit 2024-02-10T09:01:05.768633+0000 mgr.y (mgr.14883) 140 : audit [DBG] from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:07.622 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:07 smithi040 bash[35794]: cluster 2024-02-10T09:01:06.415307+0000 mgr.y (mgr.14883) 141 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:07.622 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:07 smithi040 bash[38951]: audit 2024-02-10T09:01:05.768633+0000 mgr.y (mgr.14883) 140 : audit [DBG] from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:07.623 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:07 smithi040 bash[38951]: cluster 2024-02-10T09:01:06.415307+0000 mgr.y (mgr.14883) 141 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:05.768633+0000 mgr.y (mgr.14883) 140 : audit [DBG] from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:07.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:06.415307+0000 mgr.y (mgr.14883) 141 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:08.312 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:01:08.312 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (84s) 79s ago 24m 13.6M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:01:08.312 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (64s) 26s ago 24m 46.2M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (2m) 26s ago 28m 386M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (11m) 79s ago 30m 421M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (30m) 79s ago 30m 241M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (31s) 26s ago 28m 19.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (28m) 79s ago 28m 189M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (116s) 79s ago 25m 12.8M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (109s) 26s ago 25m 14.1M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (27m) 79s ago 27m 48.9M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (27m) 79s ago 27m 46.1M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (27m) 79s ago 27m 45.2M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (26m) 79s ago 26m 50.3M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (26m) 26s ago 26m 49.2M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (26m) 26s ago 26m 45.4M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:01:08.313 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (25m) 26s ago 25m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:01:08.314 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (25m) 26s ago 25m 46.8M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:01:08.314 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (97s) 26s ago 25m 47.2M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:01:08.314 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (23m) 79s ago 23m 39.2M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:01:08.314 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (23m) 26s ago 23m 39.0M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:01:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.300913+0000 mgr.y (mgr.14883) 142 : audit [DBG] from='client.25009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.302800+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.303201+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.303512+0000 mon.c (mon.1) 461 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.303863+0000 mon.c (mon.1) 462 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.304214+0000 mon.c (mon.1) 463 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.304528+0000 mon.c (mon.1) 464 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.306196+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.306514+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.306814+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.307123+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: audit 2024-02-10T09:01:08.307412+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[35794]: cluster 2024-02-10T09:01:08.415667+0000 mgr.y (mgr.14883) 143 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:08.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.300913+0000 mgr.y (mgr.14883) 142 : audit [DBG] from='client.25009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:08.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.302800+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.303201+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.303512+0000 mon.c (mon.1) 461 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.303863+0000 mon.c (mon.1) 462 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.304214+0000 mon.c (mon.1) 463 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.304528+0000 mon.c (mon.1) 464 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.306196+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.306514+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.306814+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.307123+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: audit 2024-02-10T09:01:08.307412+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:08 smithi040 bash[38951]: cluster 2024-02-10T09:01:08.415667+0000 mgr.y (mgr.14883) 143 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.300913+0000 mgr.y (mgr.14883) 142 : audit [DBG] from='client.25009 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.302800+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.303201+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.303512+0000 mon.c (mon.1) 461 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.303863+0000 mon.c (mon.1) 462 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.304214+0000 mon.c (mon.1) 463 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.304528+0000 mon.c (mon.1) 464 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.306196+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.306514+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.306814+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.307123+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:08.307412+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:08.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:08.415667+0000 mgr.y (mgr.14883) 143 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:08.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 2'"'"'' 2024-02-10T09:01:10.904 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:01:11.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '"'"'{print $2}'"'"')' 2024-02-10T09:01:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:10.416492+0000 mgr.y (mgr.14883) 144 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:11.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:10.893208+0000 mon.c (mon.1) 470 : audit [DBG] from='client.? 172.21.15.40:0/52742423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:11 smithi040 bash[35794]: cluster 2024-02-10T09:01:10.416492+0000 mgr.y (mgr.14883) 144 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:11.811 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:11 smithi040 bash[35794]: audit 2024-02-10T09:01:10.893208+0000 mon.c (mon.1) 470 : audit [DBG] from='client.? 172.21.15.40:0/52742423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:11 smithi040 bash[38951]: cluster 2024-02-10T09:01:10.416492+0000 mgr.y (mgr.14883) 144 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:11.812 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:11 smithi040 bash[38951]: audit 2024-02-10T09:01:10.893208+0000 mon.c (mon.1) 470 : audit [DBG] from='client.? 172.21.15.40:0/52742423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:12.416961+0000 mgr.y (mgr.14883) 145 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.300738+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.301153+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.301454+0000 mon.c (mon.1) 473 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.301763+0000 mon.c (mon.1) 474 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.302069+0000 mon.c (mon.1) 475 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.302363+0000 mon.c (mon.1) 476 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.304027+0000 mon.c (mon.1) 477 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.304325+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.304611+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.304899+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.305192+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: cluster 2024-02-10T09:01:12.416961+0000 mgr.y (mgr.14883) 145 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.300738+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.301153+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.301454+0000 mon.c (mon.1) 473 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.301763+0000 mon.c (mon.1) 474 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.302069+0000 mon.c (mon.1) 475 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.302363+0000 mon.c (mon.1) 476 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.304027+0000 mon.c (mon.1) 477 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.304325+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.304611+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.304899+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[35794]: audit 2024-02-10T09:01:13.305192+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: cluster 2024-02-10T09:01:12.416961+0000 mgr.y (mgr.14883) 145 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.300738+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.301153+0000 mon.c (mon.1) 472 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.301454+0000 mon.c (mon.1) 473 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.301763+0000 mon.c (mon.1) 474 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.302069+0000 mon.c (mon.1) 475 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.302363+0000 mon.c (mon.1) 476 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.304027+0000 mon.c (mon.1) 477 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.304325+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.304611+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.304899+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:13.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:13 smithi040 bash[38951]: audit 2024-02-10T09:01:13.305192+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:14 smithi040 bash[35794]: audit 2024-02-10T09:01:13.298852+0000 mgr.y (mgr.14883) 146 : audit [DBG] from='client.25021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:14.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:14 smithi040 bash[38951]: audit 2024-02-10T09:01:13.298852+0000 mgr.y (mgr.14883) 146 : audit [DBG] from='client.25021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:14.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.298852+0000 mgr.y (mgr.14883) 146 : audit [DBG] from='client.25021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:15.000 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:13.642316+0000 mgr.y (mgr.14883) 147 : audit [DBG] from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mon", "hosts": "smithi040", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: cluster 2024-02-10T09:01:14.417545+0000 mgr.y (mgr.14883) 148 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:14.994129+0000 mon.c (mon.1) 482 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:14.994478+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:14.997642+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:15.368024+0000 mon.c (mon.1) 483 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:15.368346+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[35794]: audit 2024-02-10T09:01:15.373449+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:13.642316+0000 mgr.y (mgr.14883) 147 : audit [DBG] from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mon", "hosts": "smithi040", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:15.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: cluster 2024-02-10T09:01:14.417545+0000 mgr.y (mgr.14883) 148 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:14.994129+0000 mon.c (mon.1) 482 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:14.994478+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:14.997642+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:01:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:15.368024+0000 mon.c (mon.1) 483 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:15.368346+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:15.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:15 smithi040 bash[38951]: audit 2024-02-10T09:01:15.373449+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:01:15.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:01:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:13.642316+0000 mgr.y (mgr.14883) 147 : audit [DBG] from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "mon", "hosts": "smithi040", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:15.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:14.417545+0000 mgr.y (mgr.14883) 148 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:14.994129+0000 mon.c (mon.1) 482 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:14.994478+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:14.997642+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": null, \"target_digests\": null, \"target_version\": null, \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:01:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:15.368024+0000 mon.c (mon.1) 483 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:15.368346+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:15.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:15.373449+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-10T09:01:16.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:16 smithi040 bash[35794]: cephadm 2024-02-10T09:01:14.993377+0000 mgr.y (mgr.14883) 149 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:16.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:16 smithi040 bash[35794]: cephadm 2024-02-10T09:01:15.379855+0000 mgr.y (mgr.14883) 150 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:16.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:16 smithi040 bash[38951]: cephadm 2024-02-10T09:01:14.993377+0000 mgr.y (mgr.14883) 149 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:16.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:16 smithi040 bash[38951]: cephadm 2024-02-10T09:01:15.379855+0000 mgr.y (mgr.14883) 150 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:16.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:14.993377+0000 mgr.y (mgr.14883) 149 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:16.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:15.379855+0000 mgr.y (mgr.14883) 150 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:01:17.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:16.418024+0000 mgr.y (mgr.14883) 151 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.983676+0000 mon.c (mon.1) 484 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.984018+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.987256+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.989078+0000 mon.c (mon.1) 485 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.989953+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.990196+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.994188+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.996153+0000 mon.c (mon.1) 487 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.996944+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:01:17.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:16.997180+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:01:17.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:17.001307+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]': finished 2024-02-10T09:01:17.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:17.002863+0000 mon.c (mon.1) 489 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:01:17.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:17.003514+0000 mon.c (mon.1) 490 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-10T09:01:17.826 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: cluster 2024-02-10T09:01:16.418024+0000 mgr.y (mgr.14883) 151 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:17.826 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.983676+0000 mon.c (mon.1) 484 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:17.826 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.984018+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:17.826 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.987256+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.989078+0000 mon.c (mon.1) 485 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.989953+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.990196+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.994188+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.996153+0000 mon.c (mon.1) 487 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: cluster 2024-02-10T09:01:16.418024+0000 mgr.y (mgr.14883) 151 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.983676+0000 mon.c (mon.1) 484 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.984018+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.987256+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"progress_id\": \"bd6e768c-b8cb-4280-9230-b45fc3e744bf\", \"target_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"target_version\": \"16.2.14-521-g0e714d9a\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": [\"mon\"], \"hosts\": [\"smithi040\"], \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-10T09:01:17.827 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.989078+0000 mon.c (mon.1) 485 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.989953+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.990196+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.994188+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.996153+0000 mon.c (mon.1) 487 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.996944+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:16.997180+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:17.001307+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]': finished 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:17.002863+0000 mon.c (mon.1) 489 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[35794]: audit 2024-02-10T09:01:17.003514+0000 mon.c (mon.1) 490 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.996944+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:16.997180+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]: dispatch 2024-02-10T09:01:17.828 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:17.001307+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mgr"}]': finished 2024-02-10T09:01:17.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:17.002863+0000 mon.c (mon.1) 489 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:01:17.829 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:17 smithi040 bash[38951]: audit 2024-02-10T09:01:17.003514+0000 mon.c (mon.1) 490 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-10T09:01:18.571 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[38951]: cephadm 2024-02-10T09:01:16.988123+0000 mgr.y (mgr.14883) 152 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:01:18.571 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[38951]: cephadm 2024-02-10T09:01:16.988185+0000 mgr.y (mgr.14883) 153 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:01:18.571 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[38951]: cephadm 2024-02-10T09:01:16.996739+0000 mgr.y (mgr.14883) 154 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:01:18.571 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[38951]: cephadm 2024-02-10T09:01:17.003983+0000 mgr.y (mgr.14883) 155 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-10T09:01:18.572 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[35794]: cephadm 2024-02-10T09:01:16.988123+0000 mgr.y (mgr.14883) 152 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:01:18.572 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[35794]: cephadm 2024-02-10T09:01:16.988185+0000 mgr.y (mgr.14883) 153 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:01:18.572 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[35794]: cephadm 2024-02-10T09:01:16.996739+0000 mgr.y (mgr.14883) 154 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:01:18.572 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:18 smithi040 bash[35794]: cephadm 2024-02-10T09:01:17.003983+0000 mgr.y (mgr.14883) 155 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-10T09:01:18.732 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:01:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:16.988123+0000 mgr.y (mgr.14883) 152 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:01:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:16.988185+0000 mgr.y (mgr.14883) 153 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:01:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:16.996739+0000 mgr.y (mgr.14883) 154 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:01:18.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:17.003983+0000 mgr.y (mgr.14883) 155 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-10T09:01:19.378 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:01:19.378 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (95s) 90s ago 24m 13.6M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:01:19.378 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (75s) 37s ago 24m 46.2M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (2m) 37s ago 28m 386M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (11m) 90s ago 30m 421M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (30m) 90s ago 30m 241M 2048M 15.2.0 204a01f9b0b6 8e2006e02dbc 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (42s) 37s ago 28m 19.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (28m) 90s ago 28m 189M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (2m) 90s ago 25m 12.8M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (2m) 37s ago 25m 14.1M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (28m) 90s ago 28m 48.9M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (27m) 90s ago 27m 46.1M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (27m) 90s ago 27m 45.2M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (27m) 90s ago 27m 50.3M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (26m) 37s ago 26m 49.2M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (26m) 37s ago 26m 45.4M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (26m) 37s ago 26m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:01:19.379 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (25m) 37s ago 25m 46.8M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:01:19.380 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (108s) 37s ago 25m 47.2M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:01:19.380 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (23m) 90s ago 23m 39.2M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:01:19.380 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (23m) 37s ago 23m 39.0M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:01:19.505 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: cluster 2024-02-10T09:01:18.418346+0000 mgr.y (mgr.14883) 156 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.262566+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.262927+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.266871+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]': finished 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.270016+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.270649+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.271298+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.272227+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.368710+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.369136+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.369471+0000 mon.c (mon.1) 498 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.369807+0000 mon.c (mon.1) 499 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.370149+0000 mon.c (mon.1) 500 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.370437+0000 mon.c (mon.1) 501 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.372087+0000 mon.c (mon.1) 502 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.506 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.372382+0000 mon.c (mon.1) 503 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.507 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.372682+0000 mon.c (mon.1) 504 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.507 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.373046+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.507 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[38951]: audit 2024-02-10T09:01:19.373403+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:01:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:01:19.772 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:18.418346+0000 mgr.y (mgr.14883) 156 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.262566+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]: dispatch 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.262927+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]: dispatch 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.266871+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]': finished 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.270016+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.270649+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.271298+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:19.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.272227+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.368710+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.369136+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.369471+0000 mon.c (mon.1) 498 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.369807+0000 mon.c (mon.1) 499 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.370149+0000 mon.c (mon.1) 500 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.370437+0000 mon.c (mon.1) 501 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.372087+0000 mon.c (mon.1) 502 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.372382+0000 mon.c (mon.1) 503 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.372682+0000 mon.c (mon.1) 504 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.373046+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.373403+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: cluster 2024-02-10T09:01:18.418346+0000 mgr.y (mgr.14883) 156 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:19.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.262566+0000 mon.c (mon.1) 491 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]: dispatch 2024-02-10T09:01:19.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.262927+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]: dispatch 2024-02-10T09:01:19.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.266871+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14883 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.a"}]': finished 2024-02-10T09:01:19.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.270016+0000 mon.c (mon.1) 492 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:19.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.270649+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:19.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.271298+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.272227+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.368710+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.369136+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.369471+0000 mon.c (mon.1) 498 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.369807+0000 mon.c (mon.1) 499 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.370149+0000 mon.c (mon.1) 500 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.370437+0000 mon.c (mon.1) 501 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.372087+0000 mon.c (mon.1) 502 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.372382+0000 mon.c (mon.1) 503 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.372682+0000 mon.c (mon.1) 504 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.373046+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:19.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:19 smithi040 bash[35794]: audit 2024-02-10T09:01:19.373403+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:20.103 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:01:20.103 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi040", 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "0/2 daemons upgraded", 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading mon daemons", 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:01:20.104 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[38951]: audit 2024-02-10T09:01:18.721401+0000 mgr.y (mgr.14883) 157 : audit [DBG] from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[38951]: audit 2024-02-10T09:01:19.047239+0000 mgr.y (mgr.14883) 158 : audit [DBG] from='client.25039 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[38951]: cephadm 2024-02-10T09:01:19.262153+0000 mgr.y (mgr.14883) 159 : cephadm [INF] Upgrade: Updating mon.a 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[38951]: cephadm 2024-02-10T09:01:19.271867+0000 mgr.y (mgr.14883) 160 : cephadm [INF] Deploying daemon mon.a on smithi040 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[38951]: audit 2024-02-10T09:01:19.366804+0000 mgr.y (mgr.14883) 161 : audit [DBG] from='client.25045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[38951]: audit 2024-02-10T09:01:19.771189+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.15.40:0/861780263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: audit 2024-02-10T09:01:18.721401+0000 mgr.y (mgr.14883) 157 : audit [DBG] from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: audit 2024-02-10T09:01:19.047239+0000 mgr.y (mgr.14883) 158 : audit [DBG] from='client.25039 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: cephadm 2024-02-10T09:01:19.262153+0000 mgr.y (mgr.14883) 159 : cephadm [INF] Upgrade: Updating mon.a 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: cephadm 2024-02-10T09:01:19.271867+0000 mgr.y (mgr.14883) 160 : cephadm [INF] Deploying daemon mon.a on smithi040 2024-02-10T09:01:20.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: audit 2024-02-10T09:01:19.366804+0000 mgr.y (mgr.14883) 161 : audit [DBG] from='client.25045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: audit 2024-02-10T09:01:19.771189+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.15.40:0/861780263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:20.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 systemd[1]: Stopping Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:01:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:18.721401+0000 mgr.y (mgr.14883) 157 : audit [DBG] from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.047239+0000 mgr.y (mgr.14883) 158 : audit [DBG] from='client.25039 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:19.262153+0000 mgr.y (mgr.14883) 159 : cephadm [INF] Upgrade: Updating mon.a 2024-02-10T09:01:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:19.271867+0000 mgr.y (mgr.14883) 160 : cephadm [INF] Deploying daemon mon.a on smithi040 2024-02-10T09:01:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.366804+0000 mgr.y (mgr.14883) 161 : audit [DBG] from='client.25045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:19.771189+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.15.40:0/861780263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:20.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: debug 2024-02-10T09:01:20.767+0000 7ff78480f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:01:20.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:20 smithi040 bash[35794]: debug 2024-02-10T09:01:20.767+0000 7ff78480f700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-10T09:01:21.585 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:21 smithi040 bash[73551]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.a 2024-02-10T09:01:22.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service: Succeeded. 2024-02-10T09:01:22.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 systemd[1]: Stopped Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:01:22.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 systemd[1]: Starting Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:01:23.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.678+0000 7fdb38596880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T09:01:23.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.678+0000 7fdb38596880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-10T09:01:23.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.678+0000 7fdb38596880 0 pidfile_write: ignore empty --pid-file 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.682+0000 7fdb38596880 0 load: jerasure load: lrc load: isa 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: DB SUMMARY 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: CURRENT file: CURRENT 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 2737 Bytes 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000064.sst 000065.sst 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000062.log size: 4713605 ; 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.create_if_missing: 0 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.env: 0x56501f53f080 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.fs: Posix File System 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.info_log: 0x565020f98260 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.statistics: (nil) 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.use_fsync: 0 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T09:01:23.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.db_log_dir: 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T09:01:23.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.write_buffer_manager: 0x565021c8a390 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T09:01:23.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.unordered_write: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.row_cache: None 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.wal_filter: None 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T09:01:23.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_open_files: -1 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T09:01:23.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Compression algorithms supported: 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kZSTD supported: 0 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T09:01:23.183 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.merge_operator: 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_filter: None 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x565020f3dd28) 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cache_index_and_filter_blocks: 1 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: pin_top_level_index_and_filter: 1 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: index_type: 0 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: data_block_index_type: 0 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: index_shortening: 1 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T09:01:23.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: hash_index_allow_collision: 1 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: checksum: 1 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: no_block_cache: 0 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_cache: 0x565020f72f10 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_cache_name: BinnedLRUCache 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_cache_options: 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: capacity : 536870912 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: num_shard_bits : 4 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: strict_capacity_limit : 0 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: high_pri_pool_ratio: 0.000 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_cache_compressed: (nil) 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: persistent_cache: (nil) 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_size: 4096 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_size_deviation: 10 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_restart_interval: 16 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: index_block_restart_interval: 1 2024-02-10T09:01:23.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: metadata_block_size: 4096 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: partition_filters: 0 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: use_delta_encoding: 1 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: whole_key_filtering: 1 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: verify_compression: 0 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: read_amp_bytes_per_bit: 0 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: format_version: 2 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: enable_index_compression: 1 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: block_align: 0 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression: NoCompression 2024-02-10T09:01:23.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.num_levels: 7 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T09:01:23.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T09:01:23.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T09:01:23.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T09:01:23.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T09:01:23.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T09:01:23.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.ttl: 2592000 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.683+0000 7fdb38596880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.684+0000 7fdb38596880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 67, last_sequence is 23287, log_number is 62,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.684+0000 7fdb38596880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 62 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.684+0000 7fdb38596880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555682685544, "job": 1, "event": "recovery_started", "log_files": [62]} 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.684+0000 7fdb38596880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #62 mode 2 2024-02-10T09:01:23.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.688+0000 7fdb38596880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.695+0000 7fdb38596880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555682696654, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 67, "file_size": 4673436, "table_properties": {"data_size": 4665790, "index_size": 5862, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 965, "raw_key_size": 8296, "raw_average_key_size": 24, "raw_value_size": 4656073, "raw_average_value_size": 13898, "num_data_blocks": 182, "num_entries": 335, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707555682, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.695+0000 7fdb38596880 4 rocksdb: [version_set.cc:3826] Creating manifest 68 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.697+0000 7fdb38596880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555682698624, "job": 1, "event": "recovery_finished"} 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.698+0000 7fdb38596880 4 rocksdb: DB pointer 0x56502103b800 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.698+0000 7fdb1f387700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.698+0000 7fdb1f387700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** DB Stats ** 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T09:01:23.193 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** Compaction Stats [default] ** 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: L0 1/0 4.46 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: L6 2/0 95.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Sum 3/0 100.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** Compaction Stats [default] ** 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:01:23.194 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Flush(GB): cumulative 0.004, interval 0.004 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Cumulative compaction: 0.00 GB write, 294.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Interval compaction: 0.00 GB write, 294.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** Compaction Stats [default] ** 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: L0 1/0 4.46 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.195 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: L6 2/0 95.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Sum 3/0 100.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** Compaction Stats [default] ** 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 637.1 0.01 0.00 1 0.007 0 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Flush(GB): cumulative 0.004, interval 0.000 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Cumulative compaction: 0.00 GB write, 294.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:23.196 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.699+0000 7fdb38596880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] at bind addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 1 mon.a@-1(???) e3 preinit fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 0 mon.a@-1(???).mds e1 new map 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 0 mon.a@-1(???).mds e1 print_map 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: e1 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: legacy client fscid: -1 2024-02-10T09:01:23.197 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: No filesystems configured 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 0 mon.a@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:18.721401+0000 mgr.y (mgr.14883) 157 : audit [DBG] from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:19.047239+0000 mgr.y (mgr.14883) 158 : audit [DBG] from='client.25039 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:19.262153+0000 mgr.y (mgr.14883) 159 : cephadm [INF] Upgrade: Updating mon.a 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:19.271867+0000 mgr.y (mgr.14883) 160 : cephadm [INF] Deploying daemon mon.a on smithi040 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:19.366804+0000 mgr.y (mgr.14883) 161 : audit [DBG] from='client.25045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:19.771189+0000 mon.a (mon.0) 1038 : audit [DBG] from='client.? 172.21.15.40:0/861780263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:01:22.700+0000 7fdb38596880 1 mon.a@-1(???).paxosservice(auth 1..27) refresh upgraded, format 0 -> 3 2024-02-10T09:01:23.198 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 bash[73734]: 77d7b1c126b542d126bdd021d3dbf1fd53fa46f84aa270ce4df90de20c02c59b 2024-02-10T09:01:23.199 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:22 smithi040 systemd[1]: Started Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:01:29.498 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: ignoring --setuser ceph since I am not root 2024-02-10T09:01:29.498 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: ignoring --setgroup ceph since I am not root 2024-02-10T09:01:29.499 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:29.190+0000 7f95c1f0c700 1 -- 172.21.15.40:0/286433230 <== mon.1 v2:172.21.15.40:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cf9ff564e0 con 0x55cf9ff2d000 2024-02-10T09:01:29.499 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:29.315+0000 7f95d20ea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T09:01:29.499 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:29.399+0000 7f95d20ea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T09:01:29.499 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:22.419229+0000 mgr.y (mgr.14883) 164 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.499 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:22.419229+0000 mgr.y (mgr.14883) 164 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:22.795650+0000 mon.c (mon.1) 507 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: audit 2024-02-10T09:01:22.795650+0000 mon.c (mon.1) 507 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T09:01:19.271784Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:24.110435+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:24.419971+0000 mgr.y (mgr.14883) 165 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:26.420376+0000 mgr.y (mgr.14883) 166 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:28.420778+0000 mgr.y (mgr.14883) 167 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.500 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.112509+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.117542+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.129688+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.129746+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.131150+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e31: y(active, since 2m), standbys: x 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.131823+0000 mon.a (mon.0) 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.140821+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e32: y(active, since 2m), standbys: x 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.142493+0000 mon.a (mon.0) 9 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.142527+0000 mon.a (mon.0) 10 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: cluster 2024-02-10T09:01:29.142541+0000 mon.a (mon.0) 11 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] is down (out of quorum) 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:29 smithi040 bash[38951]: audit 2024-02-10T09:01:29.148420+0000 mon.a (mon.0) 12 : audit [INF] from='mgr.14883 ' entity='' 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T09:01:19.271784Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:29.501 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:24.110435+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:24.419971+0000 mgr.y (mgr.14883) 165 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:26.420376+0000 mgr.y (mgr.14883) 166 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:28.420778+0000 mgr.y (mgr.14883) 167 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.112509+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.117542+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.129688+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.129746+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.131150+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e31: y(active, since 2m), standbys: x 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.131823+0000 mon.a (mon.0) 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.140821+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e32: y(active, since 2m), standbys: x 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.142493+0000 mon.a (mon.0) 9 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.142527+0000 mon.a (mon.0) 10 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:29.142541+0000 mon.a (mon.0) 11 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] is down (out of quorum) 2024-02-10T09:01:29.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:29.148420+0000 mon.a (mon.0) 12 : audit [INF] from='mgr.14883 ' entity='' 2024-02-10T09:01:29.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: ignoring --setuser ceph since I am not root 2024-02-10T09:01:29.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: ignoring --setgroup ceph since I am not root 2024-02-10T09:01:29.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:29.311+0000 7fc713904680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T09:01:29.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:29.392+0000 7fc713904680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T09:01:30.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:29.751+0000 7fc713904680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T09:01:30.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:29.779+0000 7f95d20ea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T09:01:30.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:30.493+0000 7fc713904680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T09:01:30.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:30.579+0000 7fc713904680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T09:01:30.878 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:30.573+0000 7f95d20ea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T09:01:30.878 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:30.656+0000 7f95d20ea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T09:01:31.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:30.790+0000 7fc713904680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T09:01:32.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:31.741+0000 7fc713904680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T09:01:32.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:31.869+0000 7fc713904680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T09:01:32.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:31.949+0000 7fc713904680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T09:01:32.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:30.877+0000 7f95d20ea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T09:01:32.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:31.863+0000 7f95d20ea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T09:01:32.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:31.999+0000 7f95d20ea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T09:01:32.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:32.082+0000 7f95d20ea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T09:01:32.516 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:32.039+0000 7fc713904680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T09:01:32.516 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:32.236+0000 7fc713904680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T09:01:32.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:32.176+0000 7f95d20ea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T09:01:32.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:32.382+0000 7f95d20ea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T09:01:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:32.515+0000 7fc713904680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T09:01:32.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:32.613+0000 7fc713904680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T09:01:33.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:32.679+0000 7f95d20ea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T09:01:33.175 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:32.783+0000 7f95d20ea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T09:01:33.687 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:33.333+0000 7fc713904680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T09:01:33.687 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:33.415+0000 7fc713904680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T09:01:33.687 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:33.508+0000 7fc713904680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T09:01:33.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:33.547+0000 7f95d20ea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T09:01:33.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:33.638+0000 7f95d20ea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T09:01:33.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:33.736+0000 7f95d20ea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T09:01:33.946 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:33.686+0000 7fc713904680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T09:01:34.199 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:33.926+0000 7f95d20ea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T09:01:34.211 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:33.945+0000 7fc713904680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T09:01:34.211 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:34.076+0000 7fc713904680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T09:01:34.470 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:34.210+0000 7fc713904680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T09:01:34.470 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:34.382+0000 7fc713904680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T09:01:34.482 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:34.198+0000 7f95d20ea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T09:01:34.482 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:34.338+0000 7f95d20ea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T09:01:34.755 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:34.481+0000 7f95d20ea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T09:01:34.756 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:34.664+0000 7f95d20ea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T09:01:34.782 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:34.469+0000 7fc713904680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T09:01:35.675 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:34.754+0000 7f95d20ea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:30.510986+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:30.511573+0000 mon.c (mon.1) 508 : cluster [INF] mon.c calling monitor election 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:30.513044+0000 mon.a (mon.0) 14 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:34.485774+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.145:0/3784754294' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.336720+0000 mon.a (mon.0) 15 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.342693+0000 mon.a (mon.0) 16 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.354698+0000 mon.a (mon.0) 17 : cluster [DBG] fsmap 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.354743+0000 mon.a (mon.0) 18 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.355114+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e33: y(active, since 3m), standbys: x 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.355287+0000 mon.a (mon.0) 20 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.355307+0000 mon.a (mon.0) 21 : cluster [INF] Cluster is now healthy 2024-02-10T09:01:35.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.356161+0000 mon.a (mon.0) 22 : cluster [INF] Active manager daemon y restarted 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.356455+0000 mon.a (mon.0) 23 : cluster [INF] Activating manager daemon y 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.361932+0000 mon.a (mon.0) 24 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.369935+0000 mon.a (mon.0) 25 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.370350+0000 mon.a (mon.0) 26 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.370419+0000 mon.a (mon.0) 27 : cluster [DBG] Standby manager daemon x started 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:35.370630+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e34: y(active, starting, since 0.0142387s), standbys: x 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:30.510986+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:30.511573+0000 mon.c (mon.1) 508 : cluster [INF] mon.c calling monitor election 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:30.513044+0000 mon.a (mon.0) 14 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: audit 2024-02-10T09:01:34.485774+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.145:0/3784754294' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.336720+0000 mon.a (mon.0) 15 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.342693+0000 mon.a (mon.0) 16 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:35.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.354698+0000 mon.a (mon.0) 17 : cluster [DBG] fsmap 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.354743+0000 mon.a (mon.0) 18 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.355114+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e33: y(active, since 3m), standbys: x 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.355287+0000 mon.a (mon.0) 20 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.355307+0000 mon.a (mon.0) 21 : cluster [INF] Cluster is now healthy 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.356161+0000 mon.a (mon.0) 22 : cluster [INF] Active manager daemon y restarted 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.356455+0000 mon.a (mon.0) 23 : cluster [INF] Activating manager daemon y 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.361932+0000 mon.a (mon.0) 24 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.369935+0000 mon.a (mon.0) 25 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.370350+0000 mon.a (mon.0) 26 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.370419+0000 mon.a (mon.0) 27 : cluster [DBG] Standby manager daemon x started 2024-02-10T09:01:35.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:35 smithi040 bash[38951]: cluster 2024-02-10T09:01:35.370630+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e34: y(active, starting, since 0.0142387s), standbys: x 2024-02-10T09:01:35.683 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: ignoring --setuser ceph since I am not root 2024-02-10T09:01:35.683 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: ignoring --setgroup ceph since I am not root 2024-02-10T09:01:35.683 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:35.384+0000 7feb3a1d7700 1 -- 172.21.15.145:0/4166556339 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5633c7b2a4e0 con 0x5633c7b01000 2024-02-10T09:01:35.683 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:35.505+0000 7feb4a3b5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-10T09:01:35.683 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:35.586+0000 7feb4a3b5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-10T09:01:35.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:22.419229+0000 mgr.y (mgr.14883) 164 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:35.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:22.795650+0000 mon.c (mon.1) 507 : audit [INF] from='mgr.14883 172.21.15.40:0/106845335' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 441450496, \"cpu_percentage\": \"3.35%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-10T08:59:48.611862Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 198285721, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.611935Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 51306823, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612000Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612074Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47416606, \"cpu_percentage\": \"0.43%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612142Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 52764344, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612205Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 13453230, \"cpu_percentage\": \"0.48%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612266Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\", \"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\"], \"memory_usage\": 14355005, \"cpu_percentage\": \"23.12%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [], \"last_refresh\": \"2024-02-10T08:59:48.612328Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41146122, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T08:59:48.612388Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient s 2024-02-10T09:01:35.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: pace (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T09:01:19.271784Z\"}}, \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:35.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:24.110435+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:35.684 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:24.419971+0000 mgr.y (mgr.14883) 165 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:26.420376+0000 mgr.y (mgr.14883) 166 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:28.420778+0000 mgr.y (mgr.14883) 167 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.112509+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.117542+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.129688+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.129746+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.131150+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e31: y(active, since 2m), standbys: x 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.131823+0000 mon.a (mon.0) 7 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.140821+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e32: y(active, since 2m), standbys: x 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.142493+0000 mon.a (mon.0) 9 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-10T09:01:35.685 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.142527+0000 mon.a (mon.0) 10 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:29.142541+0000 mon.a (mon.0) 11 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] is down (out of quorum) 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:29.148420+0000 mon.a (mon.0) 12 : audit [INF] from='mgr.14883 ' entity='' 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:30.510986+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:30.511573+0000 mon.c (mon.1) 508 : cluster [INF] mon.c calling monitor election 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:30.513044+0000 mon.a (mon.0) 14 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:34.485774+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.145:0/3784754294' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.336720+0000 mon.a (mon.0) 15 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.342693+0000 mon.a (mon.0) 16 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.354698+0000 mon.a (mon.0) 17 : cluster [DBG] fsmap 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.354743+0000 mon.a (mon.0) 18 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-10T09:01:35.686 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.355114+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e33: y(active, since 3m), standbys: x 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.355287+0000 mon.a (mon.0) 20 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.355307+0000 mon.a (mon.0) 21 : cluster [INF] Cluster is now healthy 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.356161+0000 mon.a (mon.0) 22 : cluster [INF] Active manager daemon y restarted 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.356455+0000 mon.a (mon.0) 23 : cluster [INF] Activating manager daemon y 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.361932+0000 mon.a (mon.0) 24 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.369935+0000 mon.a (mon.0) 25 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.370350+0000 mon.a (mon.0) 26 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.370419+0000 mon.a (mon.0) 27 : cluster [DBG] Standby manager daemon x started 2024-02-10T09:01:35.687 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:35.370630+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e34: y(active, starting, since 0.0142387s), standbys: x 2024-02-10T09:01:36.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:35.951+0000 7feb4a3b5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-10T09:01:36.987 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:36.689+0000 7feb4a3b5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-10T09:01:36.987 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:36.774+0000 7feb4a3b5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-10T09:01:37.282 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:36.986+0000 7feb4a3b5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-10T09:01:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:36.371614+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e35: y(active, starting, since 1.01521s), standbys: x 2024-02-10T09:01:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:36.376934+0000 mon.c (mon.1) 509 : audit [DBG] from='mgr.? 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T09:01:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:36.377202+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.? 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T09:01:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:37 smithi040 bash[38951]: cluster 2024-02-10T09:01:36.371614+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e35: y(active, starting, since 1.01521s), standbys: x 2024-02-10T09:01:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:37 smithi040 bash[38951]: audit 2024-02-10T09:01:36.376934+0000 mon.c (mon.1) 509 : audit [DBG] from='mgr.? 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T09:01:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:37 smithi040 bash[38951]: audit 2024-02-10T09:01:36.377202+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.? 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T09:01:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:36.371614+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e35: y(active, starting, since 1.01521s), standbys: x 2024-02-10T09:01:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:36.376934+0000 mon.c (mon.1) 509 : audit [DBG] from='mgr.? 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-10T09:01:37.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:36.377202+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.? 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-10T09:01:38.220 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:37.923+0000 7feb4a3b5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-10T09:01:38.220 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:38.052+0000 7feb4a3b5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-10T09:01:38.220 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:38.131+0000 7feb4a3b5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-10T09:01:38.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:38.220+0000 7feb4a3b5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-10T09:01:38.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:38.417+0000 7feb4a3b5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-10T09:01:39.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:38.697+0000 7feb4a3b5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-10T09:01:39.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:38.796+0000 7feb4a3b5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-10T09:01:39.612 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:39.528+0000 7feb4a3b5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-10T09:01:39.882 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:39.612+0000 7feb4a3b5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-10T09:01:39.882 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:39.705+0000 7feb4a3b5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-10T09:01:40.143 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:39.882+0000 7feb4a3b5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-10T09:01:40.411 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:40.143+0000 7feb4a3b5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-10T09:01:40.411 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:40.275+0000 7feb4a3b5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-10T09:01:40.669 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:40.411+0000 7feb4a3b5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-10T09:01:40.669 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:40.583+0000 7feb4a3b5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-10T09:01:41.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x[55899]: debug 2024-02-10T09:01:40.669+0000 7feb4a3b5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-10T09:01:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:40.683090+0000 mon.a (mon.0) 30 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T09:01:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:40.683184+0000 mon.a (mon.0) 31 : cluster [DBG] Standby manager daemon x started 2024-02-10T09:01:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:40.683254+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T09:01:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:40.683580+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T09:01:41.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:40.684531+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T09:01:41.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:40.684803+0000 mon.b (mon.2) 7 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T09:01:41.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:40.683090+0000 mon.a (mon.0) 30 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T09:01:41.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:40.683184+0000 mon.a (mon.0) 31 : cluster [DBG] Standby manager daemon x started 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:40.683254+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:40.683580+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:40.684531+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:40.684803+0000 mon.b (mon.2) 7 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:40 smithi040 bash[38951]: cluster 2024-02-10T09:01:40.683090+0000 mon.a (mon.0) 30 : cluster [DBG] Standby manager daemon x restarted 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:40 smithi040 bash[38951]: cluster 2024-02-10T09:01:40.683184+0000 mon.a (mon.0) 31 : cluster [DBG] Standby manager daemon x started 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:40 smithi040 bash[38951]: audit 2024-02-10T09:01:40.683254+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:40 smithi040 bash[38951]: audit 2024-02-10T09:01:40.683580+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:40 smithi040 bash[38951]: audit 2024-02-10T09:01:40.684531+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-10T09:01:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:40 smithi040 bash[38951]: audit 2024-02-10T09:01:40.684803+0000 mon.b (mon.2) 7 : audit [DBG] from='mgr.? 172.21.15.145:0/1120601992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T09:01:41.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: [79B blob data] 2024-02-10T09:01:41.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: [80B blob data] 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:41.762+0000 7f95858b4700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: cluster 2024-02-10T09:01:40.738080+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e36: y(active, starting, since 5s), standbys: x 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.377119+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.377399+0000 mon.c (mon.1) 512 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.377640+0000 mon.c (mon.1) 513 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.379049+0000 mon.c (mon.1) 514 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.379360+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.379698+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.380002+0000 mon.c (mon.1) 517 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T09:01:41.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.380271+0000 mon.c (mon.1) 518 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.380559+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.380901+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.381281+0000 mon.c (mon.1) 521 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.381595+0000 mon.c (mon.1) 522 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.381823+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.382341+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.383244+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.384402+0000 mon.c (mon.1) 526 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.384796+0000 mon.c (mon.1) 527 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:40.738080+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e36: y(active, starting, since 5s), standbys: x 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.377119+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T09:01:41.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.377399+0000 mon.c (mon.1) 512 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.377640+0000 mon.c (mon.1) 513 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.379049+0000 mon.c (mon.1) 514 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.379360+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.379698+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.380002+0000 mon.c (mon.1) 517 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.380271+0000 mon.c (mon.1) 518 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.380559+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.380901+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.381281+0000 mon.c (mon.1) 521 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.381595+0000 mon.c (mon.1) 522 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.381823+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.382341+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T09:01:41.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.383244+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.385212+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.385625+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.386055+0000 mon.c (mon.1) 530 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.386459+0000 mon.c (mon.1) 531 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.386836+0000 mon.c (mon.1) 532 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.387197+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi145/grafana_crt"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.387584+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi145/grafana_key"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.387935+0000 mon.c (mon.1) 535 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.388271+0000 mon.c (mon.1) 536 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.388628+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.388957+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T09:01:41.929 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.389314+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.389655+0000 mon.c (mon.1) 540 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.390041+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.390446+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.390826+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.391201+0000 mon.c (mon.1) 544 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.384402+0000 mon.c (mon.1) 526 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.384796+0000 mon.c (mon.1) 527 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.385212+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.385625+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.386055+0000 mon.c (mon.1) 530 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.386459+0000 mon.c (mon.1) 531 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T09:01:41.930 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.386836+0000 mon.c (mon.1) 532 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.387197+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi145/grafana_crt"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.387584+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi145/grafana_key"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.387935+0000 mon.c (mon.1) 535 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.388271+0000 mon.c (mon.1) 536 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.388628+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.388957+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.389314+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.391564+0000 mon.c (mon.1) 545 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.391923+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.392303+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.392670+0000 mon.c (mon.1) 548 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T09:01:41.931 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.393026+0000 mon.c (mon.1) 549 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.393411+0000 mon.c (mon.1) 550 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: cluster 2024-02-10T09:01:41.407780+0000 mon.a (mon.0) 33 : cluster [INF] Manager daemon y is now available 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.519894+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.561408+0000 mon.c (mon.1) 552 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.561785+0000 mon.a (mon.0) 34 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.568433+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:41 smithi040 bash[38951]: audit 2024-02-10T09:01:41.568889+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.389655+0000 mon.c (mon.1) 540 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.390041+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T09:01:41.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.390446+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.390826+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.391201+0000 mon.c (mon.1) 544 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.391564+0000 mon.c (mon.1) 545 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.391923+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.392303+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.392670+0000 mon.c (mon.1) 548 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.393026+0000 mon.c (mon.1) 549 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.393411+0000 mon.c (mon.1) 550 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:41.407780+0000 mon.a (mon.0) 33 : cluster [INF] Manager daemon y is now available 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.519894+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.561408+0000 mon.c (mon.1) 552 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.561785+0000 mon.a (mon.0) 34 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.568433+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T09:01:41.933 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.568889+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:40.738080+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e36: y(active, starting, since 5s), standbys: x 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.377119+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.377399+0000 mon.c (mon.1) 512 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.377640+0000 mon.c (mon.1) 513 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.379049+0000 mon.c (mon.1) 514 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.379360+0000 mon.c (mon.1) 515 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.379698+0000 mon.c (mon.1) 516 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.380002+0000 mon.c (mon.1) 517 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.380271+0000 mon.c (mon.1) 518 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.380559+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.380901+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.381281+0000 mon.c (mon.1) 521 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.381595+0000 mon.c (mon.1) 522 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-10T09:01:42.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.381823+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.382341+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.383244+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.384402+0000 mon.c (mon.1) 526 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.384796+0000 mon.c (mon.1) 527 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.385212+0000 mon.c (mon.1) 528 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.385625+0000 mon.c (mon.1) 529 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi040"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.386055+0000 mon.c (mon.1) 530 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi145"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.386459+0000 mon.c (mon.1) 531 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.386836+0000 mon.c (mon.1) 532 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.387197+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi145/grafana_crt"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.387584+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/smithi145/grafana_key"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.387935+0000 mon.c (mon.1) 535 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.388271+0000 mon.c (mon.1) 536 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.388628+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.388957+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-10T09:01:42.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.389314+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.389655+0000 mon.c (mon.1) 540 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.390041+0000 mon.c (mon.1) 541 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.390446+0000 mon.c (mon.1) 542 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.390826+0000 mon.c (mon.1) 543 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.391201+0000 mon.c (mon.1) 544 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.391564+0000 mon.c (mon.1) 545 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.391923+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.392303+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.392670+0000 mon.c (mon.1) 548 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.393026+0000 mon.c (mon.1) 549 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.393411+0000 mon.c (mon.1) 550 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:41.407780+0000 mon.a (mon.0) 33 : cluster [INF] Manager daemon y is now available 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.519894+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:42.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.561408+0000 mon.c (mon.1) 552 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T09:01:42.036 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.561785+0000 mon.a (mon.0) 34 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-10T09:01:42.036 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.568433+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T09:01:42.036 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.568889+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-10T09:01:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:41.763314+0000 mon.a (mon.0) 36 : cluster [DBG] mgrmap e37: y(active, since 6s), standbys: x 2024-02-10T09:01:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:41.774039+0000 mgr.y (mgr.25069) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.799738+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:41.817151+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:43.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:41.763314+0000 mon.a (mon.0) 36 : cluster [DBG] mgrmap e37: y(active, since 6s), standbys: x 2024-02-10T09:01:43.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:41.774039+0000 mgr.y (mgr.25069) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:43.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.799738+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:43.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:41.817151+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:42 smithi040 bash[38951]: cluster 2024-02-10T09:01:41.763314+0000 mon.a (mon.0) 36 : cluster [DBG] mgrmap e37: y(active, since 6s), standbys: x 2024-02-10T09:01:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:42 smithi040 bash[38951]: cluster 2024-02-10T09:01:41.774039+0000 mgr.y (mgr.25069) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:42 smithi040 bash[38951]: audit 2024-02-10T09:01:41.799738+0000 mon.c (mon.1) 554 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:42 smithi040 bash[38951]: audit 2024-02-10T09:01:41.817151+0000 mon.c (mon.1) 555 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:45.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:43.380776+0000 mgr.y (mgr.25069) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:45.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:43.776285+0000 mon.a (mon.0) 37 : cluster [DBG] mgrmap e38: y(active, since 8s), standbys: x 2024-02-10T09:01:45.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:43.380776+0000 mgr.y (mgr.25069) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:45.214 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:43.776285+0000 mon.a (mon.0) 37 : cluster [DBG] mgrmap e38: y(active, since 8s), standbys: x 2024-02-10T09:01:45.215 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:44 smithi040 bash[38951]: cluster 2024-02-10T09:01:43.380776+0000 mgr.y (mgr.25069) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:45.215 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:44 smithi040 bash[38951]: cluster 2024-02-10T09:01:43.776285+0000 mon.a (mon.0) 37 : cluster [DBG] mgrmap e38: y(active, since 8s), standbys: x 2024-02-10T09:01:47.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:45.381220+0000 mgr.y (mgr.25069) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:47.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:45.875722+0000 mon.c (mon.1) 556 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"77d7b1c126b5\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 38042337, \"cpu_percentage\": \"1.15%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.873627Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T09:01:22.274490Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 427189862, \"cpu_percentage\": \"4.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:01:45.873800Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 209400627, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.873876Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51390709, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.873941Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48465182, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874005Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47888465, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874073Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52869201, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874144Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 15026094, \"cpu_percentage\": \"0.57%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.874208Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\", \"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15497953, \"cpu_percentage\": \"0.18%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.874271Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c6928 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: 2dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41775267, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874333Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T09:01:19.271784Z\"}}, \"last_daemon_update\": \"2024-02-10T09:01:45.874463Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:45.882166+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.177349+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.177755+0000 mon.c (mon.1) 558 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.178086+0000 mon.c (mon.1) 559 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.178380+0000 mon.c (mon.1) 560 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.178670+0000 mon.c (mon.1) 561 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.178956+0000 mon.c (mon.1) 562 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.179258+0000 mon.c (mon.1) 563 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.179545+0000 mon.c (mon.1) 564 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.179873+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.238542+0000 mon.c (mon.1) 566 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 41240494, \"cpu_percentage\": \"0.82%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.236684Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 400136601, \"cpu_percentage\": \"11.66%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:01:46.236828Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.236903Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47710208, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.236971Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237036Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49199185, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237115Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 52240056, \"cpu_percentage\": \"0.53%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237181Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 24337448, \"cpu_percentage\": \"0.69%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237244Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 49104814, \"cpu_percentage\": \"1.09%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237307Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbb 2024-02-10T09:01:47.034 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: f1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41439723, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237370Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:01:46.237483Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.242499+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.521890+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.522351+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.522734+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.523125+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.523488+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.523845+0000 mon.c (mon.1) 572 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.524226+0000 mon.c (mon.1) 573 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.524579+0000 mon.c (mon.1) 574 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.524942+0000 mon.c (mon.1) 575 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.526294+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.529637+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.535904+0000 mon.c (mon.1) 577 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:47.035 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.536938+0000 mon.c (mon.1) 578 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:47.036 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.538704+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:47.036 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.539842+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:01:47.036 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:46.540553+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-10T09:01:47.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:45.381220+0000 mgr.y (mgr.25069) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:47.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:45.875722+0000 mon.c (mon.1) 556 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"77d7b1c126b5\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 38042337, \"cpu_percentage\": \"1.15%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.873627Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T09:01:22.274490Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 427189862, \"cpu_percentage\": \"4.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:01:45.873800Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 209400627, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.873876Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51390709, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.873941Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48465182, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874005Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47888465, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874073Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52869201, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874144Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 15026094, \"cpu_percentage\": \"0.57%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.874208Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\", \"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15497953, \"cpu_percentage\": \"0.18%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.874271Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c6928 2024-02-10T09:01:47.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: cluster 2024-02-10T09:01:45.381220+0000 mgr.y (mgr.25069) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 2dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41775267, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874333Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T09:01:19.271784Z\"}}, \"last_daemon_update\": \"2024-02-10T09:01:45.874463Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:45.882166+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.177349+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.177755+0000 mon.c (mon.1) 558 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.178086+0000 mon.c (mon.1) 559 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.178380+0000 mon.c (mon.1) 560 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.178670+0000 mon.c (mon.1) 561 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.178956+0000 mon.c (mon.1) 562 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.179258+0000 mon.c (mon.1) 563 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.179545+0000 mon.c (mon.1) 564 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.179873+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:45.875722+0000 mon.c (mon.1) 556 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi040","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi040\", \"container_id\": \"77d7b1c126b5\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 38042337, \"cpu_percentage\": \"1.15%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.873627Z\", \"created\": \"2024-02-10T08:30:59.049472Z\", \"started\": \"2024-02-10T09:01:22.274490Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi040\", \"container_id\": \"396268bc9a9f\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 427189862, \"cpu_percentage\": \"4.07%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:01:45.873800Z\", \"created\": \"2024-02-10T08:31:06.341381Z\", \"started\": \"2024-02-10T08:49:26.949423Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi040\", \"container_id\": \"7c5b86a3c45a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 209400627, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.873876Z\", \"created\": \"2024-02-10T08:32:26.230367Z\", \"started\": \"2024-02-10T08:32:26.262906Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi040\", \"container_id\": \"f1d32c2ff24b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 51390709, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.873941Z\", \"created\": \"2024-02-10T08:33:15.560734Z\", \"started\": \"2024-02-10T08:33:18.375011Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi040\", \"container_id\": \"001988d9b38e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48465182, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874005Z\", \"created\": \"2024-02-10T08:33:35.299480Z\", \"started\": \"2024-02-10T08:33:37.463127Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi040\", \"container_id\": \"7c5ab0f6a731\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47888465, \"cpu_percentage\": \"0.42%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874073Z\", \"created\": \"2024-02-10T08:33:55.493219Z\", \"started\": \"2024-02-10T08:34:00.121605Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi040\", \"container_id\": \"cbafd2240310\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52869201, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874144Z\", \"created\": \"2024-02-10T08:34:15.851956Z\", \"started\": \"2024-02-10T08:34:18.741266Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi040\", \"container_id\": \"55e529403579\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 15026094, \"cpu_percentage\": \"0.57%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.874208Z\", \"created\": \"2024-02-10T08:36:04.296557Z\", \"started\": \"2024-02-10T08:59:11.364141Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi040\", \"container_id\": \"ea79f9a9c57e\", \"container_image_id\": \"ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4\", \"container_image_name\": \"quay.io/prometheus/alertmanager:v0.23.0\", \"container_image_digests\": [\"quay.io/prometheus/alertmanager@sha256:3915fd90525daa23260082194e3ca8a75c51af5d436b64eeff16f0c7e54ef829\", \"quay.io/prometheus/alertmanager@sha256:9ab73a421b65b80be072f96a88df756fc5b52a1bc8d983537b8ec5be8b624c5a\"], \"memory_usage\": 15497953, \"cpu_percentage\": \"0.18%\", \"version\": \"0.23.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:45.874271Z\", \"created\": \"2024-02-10T08:36:23.300313Z\", \"started\": \"2024-02-10T08:59:43.748981Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi040.skjeib\", \"daemon_name\": \"rgw.r.z.smithi040.skjeib\", \"hostname\": \"smithi040\", \"container_id\": \"8432d04a8751\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41775267, \"cpu_percentage\": \"0.14%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:45.874333Z\", \"created\": \"2024-02-10T08:37:59.058079Z\", \"started\": \"2024-02-10T08:37:59.273190Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355958Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"98f5c8b5-a97a-4e49-a7eb-46639f974dde\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FGa9jQ-MTf4-4DTy-j5kF-wxoC-Hrfy-eBzNmL\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f5397c1c-cc08-4591-9a75-867299f80a86\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"LhYsd5-iUee-3wny-vWS1-2TzJ-YZhc-OgJSKz\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"09f46a8e-6338-4458-a3d6-28560e580b5a\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"RTxLf0-I5Pw-8HHi-XZe6-j3sn-fuJ2-U8GZZA\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"066f4269-9cf7-4480-8575-a2fcf6a72404\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"3O9Muu-Jxyt-EF1w-Lqbb-Yy1o-qsi8-CtK1Ly\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5330009J400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.355971Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ07\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-10T08:45:50.504649Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-10T08:48:43.152773Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:13.802186Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:33.577283Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-10T08:33:53.617750Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:14.010987Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:07.644820Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-10T08:59:38.967050Z\"}, \"rgw.r.z.smithi040.skjeib\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:55.517925Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-10T09:01:19.271784Z\"}}, \"last_daemon_update\": \"2024-02-10T09:01:45.874463Z\", \"last_device_update\": \"2024-02-10T08:34:23.237900Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:52:08.098999Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:45.882166+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.177349+0000 mon.c (mon.1) 557 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.177755+0000 mon.c (mon.1) 558 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.178086+0000 mon.c (mon.1) 559 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.178380+0000 mon.c (mon.1) 560 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.178670+0000 mon.c (mon.1) 561 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.178956+0000 mon.c (mon.1) 562 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.179258+0000 mon.c (mon.1) 563 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.179545+0000 mon.c (mon.1) 564 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.179873+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.238542+0000 mon.c (mon.1) 566 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 41240494, \"cpu_percentage\": \"0.82%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.236684Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 400136601, \"cpu_percentage\": \"11.66%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:01:46.236828Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.236903Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47710208, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.236971Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237036Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49199185, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237115Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 52240056, \"cpu_percentage\": \"0.53%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237181Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 24337448, \"cpu_percentage\": \"0.69%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237244Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 49104814, \"cpu_percentage\": \"1.09%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237307Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41439723, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237370Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:01:46.237483Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.242499+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.238542+0000 mon.c (mon.1) 566 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi145","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"service_name\": \"mon\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi145\", \"container_id\": \"61b9d8dce82b\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 41240494, \"cpu_percentage\": \"0.82%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.236684Z\", \"created\": \"2024-02-10T08:32:39.006939Z\", \"started\": \"2024-02-10T09:00:37.017666Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi145\", \"container_id\": \"80326d960b75\", \"container_image_id\": \"1fbc92c859dc0947ffca020b41c01a6ac9859691b5303dd3e8b8634d23f540d5\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc\"], \"memory_usage\": 400136601, \"cpu_percentage\": \"11.66%\", \"version\": \"16.2.14-521-g0e714d9a\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-10T09:01:46.236828Z\", \"created\": \"2024-02-10T08:32:58.437528Z\", \"started\": \"2024-02-10T08:58:59.454866Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi145\", \"container_id\": \"b098e00a569d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 52051312, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.236903Z\", \"created\": \"2024-02-10T08:34:32.248539Z\", \"started\": \"2024-02-10T08:34:34.689979Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi145\", \"container_id\": \"b91a5ba45b8a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47710208, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.236971Z\", \"created\": \"2024-02-10T08:34:52.119116Z\", \"started\": \"2024-02-10T08:34:55.852345Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi145\", \"container_id\": \"6911ceebe5f2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47678750, \"cpu_percentage\": \"0.48%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237036Z\", \"created\": \"2024-02-10T08:35:11.424706Z\", \"started\": \"2024-02-10T08:35:14.017865Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi145\", \"container_id\": \"0bad5adb0a7c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49199185, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237115Z\", \"created\": \"2024-02-10T08:35:30.858292Z\", \"started\": \"2024-02-10T08:35:33.238367Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi145\", \"container_id\": \"b6b7f64e78cb\", \"container_image_id\": \"514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d\", \"container_image_name\": \"quay.io/prometheus/prometheus:v2.33.4\", \"container_image_digests\": [\"quay.io/prometheus/prometheus@sha256:fb7e3a27469dd7e15f3b181cf510954db04b855722be94448dc23494005c433c\", \"quay.io/prometheus/prometheus@sha256:35337321e0e7d8c62b5035b712f895170fe2ec42d3181f0d46a7d1af3dfdb1d4\"], \"memory_usage\": 52240056, \"cpu_percentage\": \"0.53%\", \"version\": \"2.33.4\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237181Z\", \"created\": \"2024-02-10T08:35:59.812676Z\", \"started\": \"2024-02-10T08:59:31.276852Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"service_name\": \"node-exporter\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi145\", \"container_id\": \"3bf2c54c82c9\", \"container_image_id\": \"1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26\", \"container_image_name\": \"quay.io/prometheus/node-exporter:v1.3.1\", \"container_image_digests\": [\"quay.io/prometheus/node-exporter@sha256:d5b2a2e2bb07a4a5a7c4bd9e54641cab63e1d2627622dbde17efc04849d3d30d\", \"quay.io/prometheus/node-exporter@sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd\"], \"memory_usage\": 24337448, \"cpu_percentage\": \"0.69%\", \"version\": \"1.3.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237244Z\", \"created\": \"2024-02-10T08:36:03.384600Z\", \"started\": \"2024-02-10T08:59:18.783899Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"service_name\": \"grafana\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi145\", \"container_id\": \"c95486c769a1\", \"container_image_id\": \"dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01\", \"container_image_name\": \"quay.io/ceph/ceph-grafana:8.3.5\", \"container_image_digests\": [\"quay.io/ceph/ceph-grafana@sha256:f5273853535cbeb49c24ab539ad6e21ca41c9e894753f33b992f232ce40d6c00\", \"quay.io/ceph/ceph-grafana@sha256:09d5d36bc52314dc0f86e616d959d147bb61d4120dcce1f9be244b324c4b0f36\"], \"memory_usage\": 49104814, \"cpu_percentage\": \"1.09%\", \"version\": \"8.3.5\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-10T09:01:46.237307Z\", \"created\": \"2024-02-10T08:36:40.854802Z\", \"started\": \"2024-02-10T09:00:03.967558Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi145.uizklq\", \"daemon_name\": \"rgw.r.z.smithi145.uizklq\", \"hostname\": \"smithi145\", \"container_id\": \"55d99cc72c2c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c692 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.521890+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.522351+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.522734+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.523125+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.523488+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.523845+0000 mon.c (mon.1) 572 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.524226+0000 mon.c (mon.1) 573 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.524579+0000 mon.c (mon.1) 574 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.524942+0000 mon.c (mon.1) 575 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.526294+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.529637+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.535904+0000 mon.c (mon.1) 577 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.536938+0000 mon.c (mon.1) 578 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.538704+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.539842+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:46 smithi040 bash[38951]: audit 2024-02-10T09:01:46.540553+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: 82dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41439723, \"cpu_percentage\": \"0.13%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-10T09:01:46.237370Z\", \"created\": \"2024-02-10T08:38:00.979091Z\", \"started\": \"2024-02-10T08:38:01.010487Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357143Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5ae9db50-c5f1-4b9f-a002-c5fd59c0a0b0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"K0xvlU-6TGs-IEn3-HQIA-57ft-qubU-2ceGEw\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1b66a495-8002-4920-a6b2-c8a2ddf2f530\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"UdP9Wn-qmCz-Lind-wQdV-73Nl-Tbxa-FaZQ7B\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"65bd977b-afd2-4a17-b201-37abf5a7dba9\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"edOGsE-eS7D-5ePc-f8Ys-2AzZ-kDfk-fcPXSm\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f1eac730-f5c7-46ec-a931-196ac88f2df0\", \"cluster_fsid\": \"a67cbc88-c7ee-11ee-95b8-87774f69a715\", \"block_uuid\": \"FcS5ey-x3Lu-tv9Y-IATT-c32r-8LvD-aNHpsV\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT620500N9400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-10T08:45:42.357152Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5XLDP\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-10T09:00:34.001113Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-10T08:58:46.360051Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:30.617649Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-10T08:34:50.405314Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:09.689685Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-10T08:35:29.030179Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-10T08:59:26.218329Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-10T08:59:13.495481Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-10T08:59:50.559807Z\"}, \"rgw.r.z.smithi145.uizklq\": {\"deps\": [], \"last_config\": \"2024-02-10T08:37:59.099513Z\"}}, \"last_daemon_update\": \"2024-02-10T09:01:46.237483Z\", \"last_device_update\": \"2024-02-10T08:35:37.228807Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-10T08:56:30.151866Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.242499+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.521890+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.522351+0000 mon.c (mon.1) 568 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.522734+0000 mon.c (mon.1) 569 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.523125+0000 mon.c (mon.1) 570 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.523488+0000 mon.c (mon.1) 571 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.523845+0000 mon.c (mon.1) 572 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.524226+0000 mon.c (mon.1) 573 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.524579+0000 mon.c (mon.1) 574 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.524942+0000 mon.c (mon.1) 575 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.526294+0000 mon.c (mon.1) 576 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.529637+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.535904+0000 mon.c (mon.1) 577 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.536938+0000 mon.c (mon.1) 578 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.538704+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.539842+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-10T09:01:47.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:46.540553+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-10T09:01:47.855 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:46.541075+0000 mgr.y (mgr.25069) 4 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-10T09:01:47.855 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:47 smithi040 bash[38951]: cephadm 2024-02-10T09:01:46.541075+0000 mgr.y (mgr.25069) 4 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-10T09:01:48.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:46.541075+0000 mgr.y (mgr.25069) 4 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-10T09:01:49.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:47.382073+0000 mgr.y (mgr.25069) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:49.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:47.877294+0000 mgr.y (mgr.25069) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:47.877788+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.c"}]: dispatch 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:47.883133+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:47.885086+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:47.885773+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:47.886445+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:47.887078+0000 mgr.y (mgr.25069) 7 : cephadm [INF] Deploying daemon mon.c on smithi040 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:47.887504+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: cluster 2024-02-10T09:01:47.382073+0000 mgr.y (mgr.25069) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: cephadm 2024-02-10T09:01:47.877294+0000 mgr.y (mgr.25069) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: audit 2024-02-10T09:01:47.877788+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.c"}]: dispatch 2024-02-10T09:01:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: audit 2024-02-10T09:01:47.883133+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:49.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: audit 2024-02-10T09:01:47.885086+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:49.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: audit 2024-02-10T09:01:47.885773+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:49.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: audit 2024-02-10T09:01:47.886445+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:49.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: cephadm 2024-02-10T09:01:47.887078+0000 mgr.y (mgr.25069) 7 : cephadm [INF] Deploying daemon mon.c on smithi040 2024-02-10T09:01:49.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:48 smithi040 bash[38951]: audit 2024-02-10T09:01:47.887504+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:01:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:47.382073+0000 mgr.y (mgr.25069) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:47.877294+0000 mgr.y (mgr.25069) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-10T09:01:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:47.877788+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.c"}]: dispatch 2024-02-10T09:01:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:47.883133+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:47.885086+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:47.885773+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:47.886445+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:47.887078+0000 mgr.y (mgr.25069) 7 : cephadm [INF] Deploying daemon mon.c on smithi040 2024-02-10T09:01:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:47.887504+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:01:49.554 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:49 smithi040 systemd[1]: Stopping Ceph mon.c for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:01:49.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:49 smithi040 bash[38951]: debug 2024-02-10T09:01:49.552+0000 7f7667ed4700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:01:49.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:49 smithi040 bash[38951]: debug 2024-02-10T09:01:49.552+0000 7f7667ed4700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-02-10T09:01:50.287 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:50 smithi040 bash[74858]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.c 2024-02-10T09:01:50.504 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:01:51.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:50 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.c.service: Succeeded. 2024-02-10T09:01:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:50 smithi040 systemd[1]: Stopped Ceph mon.c for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:01:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:50 smithi040 systemd[1]: Starting Ceph mon.c for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:01:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.396+0000 7f5608693880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-10T09:01:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.396+0000 7f5608693880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-10T09:01:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.396+0000 7f5608693880 0 pidfile_write: ignore empty --pid-file 2024-02-10T09:01:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.401+0000 7f5608693880 0 load: jerasure load: lrc load: isa 2024-02-10T09:01:51.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: RocksDB version: 6.8.1 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Compile date Feb 8 2024 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: DB SUMMARY 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: CURRENT file: CURRENT 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 3071 Bytes 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000071.sst 000072.sst 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000069.log size: 10814459 ; 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.error_if_exists: 0 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.create_if_missing: 0 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.paranoid_checks: 1 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.env: 0x56256481c080 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.fs: Posix File System 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.info_log: 0x562565ae6260 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.statistics: (nil) 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.use_fsync: 0 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_log_file_size: 0 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-10T09:01:51.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.allow_fallocate: 1 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.use_direct_reads: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.db_log_dir: 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_subcompactions: 1 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_background_flushes: -1 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-10T09:01:51.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.write_buffer_manager: 0x5625667d8390 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.unordered_write: 0 2024-02-10T09:01:51.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.row_cache: None 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.wal_filter: None 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.preserve_deletes: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.two_write_queues: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.atomic_flush: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.log_readahead_size: 0 2024-02-10T09:01:51.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_background_jobs: 2 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_background_compactions: -1 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_open_files: -1 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-10T09:01:51.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Compression algorithms supported: 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kZSTD supported: 0 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kXpressCompression supported: 0 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kLZ4Compression supported: 1 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kBZip2Compression supported: 0 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kZlibCompression supported: 1 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: kSnappyCompression supported: 1 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-10T09:01:51.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.merge_operator: 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_filter: None 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562565a8bd28) 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cache_index_and_filter_blocks: 1 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: pin_top_level_index_and_filter: 1 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: index_type: 0 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: data_block_index_type: 0 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: index_shortening: 1 2024-02-10T09:01:51.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: data_block_hash_table_util_ratio: 0.750000 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: hash_index_allow_collision: 1 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: checksum: 1 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: no_block_cache: 0 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_cache: 0x562565ac0f10 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_cache_name: BinnedLRUCache 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_cache_options: 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: capacity : 536870912 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: num_shard_bits : 4 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: strict_capacity_limit : 0 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: high_pri_pool_ratio: 0.000 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_cache_compressed: (nil) 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: persistent_cache: (nil) 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_size: 4096 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_size_deviation: 10 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_restart_interval: 16 2024-02-10T09:01:51.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: index_block_restart_interval: 1 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: metadata_block_size: 4096 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: partition_filters: 0 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: use_delta_encoding: 1 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: whole_key_filtering: 1 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: verify_compression: 0 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: read_amp_bytes_per_bit: 0 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: format_version: 2 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: enable_index_compression: 1 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: block_align: 0 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression: NoCompression 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-10T09:01:51.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.num_levels: 7 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-10T09:01:51.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-10T09:01:51.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-10T09:01:51.690 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.table_properties_collectors: 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.inplace_update_support: 0 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-10T09:01:51.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.bloom_locality: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.max_successive_merges: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.ttl: 2592000 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.402+0000 7f5608693880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.403+0000 7f5608693880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 74, last_sequence is 25295, log_number is 69,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.403+0000 7f5608693880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 69 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.403+0000 7f5608693880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555711404570, "job": 1, "event": "recovery_started", "log_files": [69]} 2024-02-10T09:01:51.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.403+0000 7f5608693880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #69 mode 2 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.416+0000 7f5608693880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.425+0000 7f5608693880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555711426243, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 74, "file_size": 7137421, "table_properties": {"data_size": 7127817, "index_size": 7692, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1093, "raw_key_size": 10093, "raw_average_key_size": 23, "raw_value_size": 7115445, "raw_average_value_size": 16781, "num_data_blocks": 239, "num_entries": 424, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707555711, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.425+0000 7f5608693880 4 rocksdb: [version_set.cc:3826] Creating manifest 75 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.427+0000 7f5608693880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707555711428076, "job": 1, "event": "recovery_finished"} 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.428+0000 7f5608693880 4 rocksdb: DB pointer 0x562565b89800 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.428+0000 7f55ef484700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.428+0000 7f55ef484700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** DB Stats ** 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T09:01:51.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** Compaction Stats [default] ** 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: L0 1/0 6.81 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: L6 2/0 95.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Sum 3/0 102.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** Compaction Stats [default] ** 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:51.694 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Flush(GB): cumulative 0.007, interval 0.007 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Cumulative compaction: 0.01 GB write, 261.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Interval compaction: 0.01 GB write, 261.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** Compaction Stats [default] ** 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:51.695 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: L0 1/0 6.81 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: L6 2/0 95.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Sum 3/0 102.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** Compaction Stats [default] ** 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 734.0 0.01 0.00 1 0.009 0 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Flush(GB): cumulative 0.007, interval 0.000 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(Total Files): cumulative 0, interval 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-10T09:01:51.696 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: AddFile(Keys): cumulative 0, interval 0 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Cumulative compaction: 0.01 GB write, 260.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: ** File Read Latency Histogram By Level [default] ** 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.429+0000 7f5608693880 0 starting mon.c rank 1 at public addrs [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] at bind addrs [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 1 mon.c@-1(???) e3 preinit fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 0 mon.c@-1(???).mds e1 new map 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 0 mon.c@-1(???).mds e1 print_map 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: e1 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-10T09:01:51.697 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: legacy client fscid: -1 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: No filesystems configured 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 0 mon.c@-1(???).osd e66 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.430+0000 7f5608693880 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:47.382073+0000 mgr.y (mgr.25069) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:47.877294+0000 mgr.y (mgr.25069) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:47.877788+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "who": "mon.c"}]: dispatch 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:47.883133+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:47.885086+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:47.885773+0000 mon.c (mon.1) 584 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:47.886445+0000 mon.c (mon.1) 585 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:47.887078+0000 mgr.y (mgr.25069) 7 : cephadm [INF] Deploying daemon mon.c on smithi040 2024-02-10T09:01:51.698 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:47.887504+0000 mon.c (mon.1) 586 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:01:51.699 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:01:51.431+0000 7f5608693880 1 mon.c@-1(???).paxosservice(auth 1..28) refresh upgraded, format 0 -> 3 2024-02-10T09:01:51.699 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 bash[75116]: c673a83ed8be3f3c3570ceb2159427ba312829148801098d4681a84c31c5f457 2024-02-10T09:01:51.699 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:51 smithi040 systemd[1]: Started Ceph mon.c for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (2m) 6s ago 25m 14.7M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (108s) 6s ago 25m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (2m) 6s ago 28m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (12m) 6s ago 30m 407M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (30s) 6s ago 30m 36.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (75s) 6s ago 29m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:01:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (29m) 6s ago 29m 199M 2048M 15.2.0 204a01f9b0b6 7c5b86a3c45a 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (2m) 6s ago 25m 14.3M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (2m) 6s ago 25m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (28m) 6s ago 28m 49.0M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (28m) 6s ago 28m 46.2M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (27m) 6s ago 27m 45.6M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (27m) 6s ago 27m 50.4M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (27m) 6s ago 27m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (26m) 6s ago 27m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (26m) 6s ago 26m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (26m) 6s ago 26m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (2m) 6s ago 25m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (23m) 6s ago 23m 39.8M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:01:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (23m) 6s ago 23m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:01:53.310 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:01:53.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:01:53.310 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:01:53.310 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:53.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:01:53.310 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:01:53.311 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:01:53.648 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:01:53.648 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi040", 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "1/2 daemons upgraded", 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading mon daemons", 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:01:53.649 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.811595+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.825376+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.825429+0000 mon.a (mon.0) 48 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.825661+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.825832+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.826442+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.826447+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.826493+0000 mon.b (mon.2) 16 : cluster [INF] mon.b calling monitor election 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.839148+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.843986+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.844441+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.844472+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.844836+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e38: y(active, since 17s), standbys: x 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.854510+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:52.856671+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.857494+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.859832+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25069 ' entity='' 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.860658+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.861537+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.861832+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.863830+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.864286+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.864960+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.865429+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:52.865992+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:53.310438+0000 mon.a (mon.0) 57 : audit [DBG] from='client.? 172.21.15.40:0/98194155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.811595+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.825376+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.825429+0000 mon.a (mon.0) 48 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.825661+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.825832+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.826442+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.826447+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:54.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.826493+0000 mon.b (mon.2) 16 : cluster [INF] mon.b calling monitor election 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.839148+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.843986+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.844441+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.844472+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.844836+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e38: y(active, since 17s), standbys: x 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.854510+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:52.856671+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.857494+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.859832+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25069 ' entity='' 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.860658+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.861537+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.861832+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:54.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.863830+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:54.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.864286+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.864960+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.865429+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:52.865992+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:53.310438+0000 mon.a (mon.0) 57 : audit [DBG] from='client.? 172.21.15.40:0/98194155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.811595+0000 mon.b (mon.2) 12 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.825376+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-10T09:01:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.825429+0000 mon.a (mon.0) 48 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.825661+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.825832+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.826442+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.826447+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.826493+0000 mon.b (mon.2) 16 : cluster [INF] mon.b calling monitor election 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.839148+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.843986+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0]} removed_ranks: {} 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.844441+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.844472+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.844836+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e38: y(active, since 17s), standbys: x 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.854510+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:52.856671+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.857494+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.859832+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25069 ' entity='' 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.860658+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.861537+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.861832+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.863830+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.864286+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.864960+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.865429+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:52.865992+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:01:54.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:53.310438+0000 mon.a (mon.0) 57 : audit [DBG] from='client.? 172.21.15.40:0/98194155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:01:55.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:53.383728+0000 mgr.y (mgr.25069) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:55.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:53.648594+0000 mgr.y (mgr.25069) 14 : audit [DBG] from='client.54153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:55.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:53.383728+0000 mgr.y (mgr.25069) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:55.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:53.648594+0000 mgr.y (mgr.25069) 14 : audit [DBG] from='client.54153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:53.383728+0000 mgr.y (mgr.25069) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:53.648594+0000 mgr.y (mgr.25069) 14 : audit [DBG] from='client.54153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:01:56.863 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:01:56.436+0000 7f95858b4700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-10T09:01:57.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:55.384273+0000 mgr.y (mgr.25069) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:56.799602+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:56.804958+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:56.808489+0000 mon.b (mon.2) 27 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:56.809915+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:56.810653+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:56.811700+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:55.384273+0000 mgr.y (mgr.25069) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:56.799602+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:56.804958+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:56.808489+0000 mon.b (mon.2) 27 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:56.809915+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:56.810653+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:56.811700+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T09:01:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:55.384273+0000 mgr.y (mgr.25069) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:56.799602+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:56.804958+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:56.808489+0000 mon.b (mon.2) 27 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:01:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:56.809915+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:01:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:56.810653+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:56.811700+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-10T09:01:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:56.808125+0000 mgr.y (mgr.25069) 16 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-10T09:01:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:56.811263+0000 mgr.y (mgr.25069) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-10T09:01:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:56.808125+0000 mgr.y (mgr.25069) 16 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-10T09:01:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:56.811263+0000 mgr.y (mgr.25069) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-10T09:01:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:56.808125+0000 mgr.y (mgr.25069) 16 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-10T09:01:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:56.811263+0000 mgr.y (mgr.25069) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi040 2024-02-10T09:01:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:57.384834+0000 mgr.y (mgr.25069) 18 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:58.149733+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:58.151046+0000 mgr.y (mgr.25069) 19 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-10T09:01:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:58.151392+0000 mon.b (mon.2) 31 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:58.151937+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:58.152988+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:58.154006+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:58.154860+0000 mgr.y (mgr.25069) 20 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:58.155280+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:57.384834+0000 mgr.y (mgr.25069) 18 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:58.149733+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:58.151046+0000 mgr.y (mgr.25069) 19 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:58.151392+0000 mon.b (mon.2) 31 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:58.151937+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:58.152988+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T09:01:59.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:58.154006+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:59.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:58.154860+0000 mgr.y (mgr.25069) 20 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-10T09:01:59.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:01:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:58.155280+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-10T09:01:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:57.384834+0000 mgr.y (mgr.25069) 18 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:01:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:58.149733+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:01:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:58.151046+0000 mgr.y (mgr.25069) 19 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-10T09:01:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:58.151392+0000 mon.b (mon.2) 31 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:01:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:58.151937+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:01:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:58.152988+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T09:01:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:58.154006+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:01:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:58.154860+0000 mgr.y (mgr.25069) 20 : cephadm [INF] Reconfiguring daemon mgr.y on smithi040 2024-02-10T09:01:59.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:01:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:58.155280+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-10T09:02:00.804 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:01:59.385183+0000 mgr.y (mgr.25069) 21 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:59.554126+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:59.557135+0000 mgr.y (mgr.25069) 22 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:59.557502+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:59.558451+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:59.559247+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:01:59.560020+0000 mgr.y (mgr.25069) 23 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:01:59.560543+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:01:59.385183+0000 mgr.y (mgr.25069) 21 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:59.554126+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:59.557135+0000 mgr.y (mgr.25069) 22 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:59.557502+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:02:00.805 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:59.558451+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:02:00.806 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:59.559247+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:00.806 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:01:59.560020+0000 mgr.y (mgr.25069) 23 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-10T09:02:00.806 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:01:59.560543+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:02:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:01:59.385183+0000 mgr.y (mgr.25069) 21 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:59.554126+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:59.557135+0000 mgr.y (mgr.25069) 22 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-10T09:02:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:59.557502+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:02:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:59.558451+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:02:01.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:59.559247+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:01.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:01:59.560020+0000 mgr.y (mgr.25069) 23 : cephadm [INF] Reconfiguring daemon mon.c on smithi040 2024-02-10T09:02:01.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:01:59.560543+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-10T09:02:02.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:00.853324+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:02.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:00.854660+0000 mgr.y (mgr.25069) 24 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-10T09:02:02.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:00.854908+0000 mon.b (mon.2) 39 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T09:02:02.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:00.855808+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:02.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:00.857227+0000 mgr.y (mgr.25069) 25 : cephadm [INF] Reconfiguring daemon osd.0 on smithi040 2024-02-10T09:02:02.169 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:00.857632+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-10T09:02:02.170 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:00.853324+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:02.170 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:00.854660+0000 mgr.y (mgr.25069) 24 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-10T09:02:02.170 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:00.854908+0000 mon.b (mon.2) 39 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T09:02:02.170 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:00.855808+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:02.170 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:00.857227+0000 mgr.y (mgr.25069) 25 : cephadm [INF] Reconfiguring daemon osd.0 on smithi040 2024-02-10T09:02:02.170 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:00.857632+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-10T09:02:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:00.853324+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:00.854660+0000 mgr.y (mgr.25069) 24 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-10T09:02:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:00.854908+0000 mon.b (mon.2) 39 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T09:02:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:00.855808+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:00.857227+0000 mgr.y (mgr.25069) 25 : cephadm [INF] Reconfiguring daemon osd.0 on smithi040 2024-02-10T09:02:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:00.857632+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-10T09:02:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:01.385490+0000 mgr.y (mgr.25069) 26 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:02.248843+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:02.250971+0000 mon.b (mon.2) 42 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T09:02:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:02.251909+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:03.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:02.253548+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-10T09:02:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:01.385490+0000 mgr.y (mgr.25069) 26 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:02.248843+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:02.250971+0000 mon.b (mon.2) 42 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T09:02:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:02.251909+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:02.253548+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-10T09:02:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:01.385490+0000 mgr.y (mgr.25069) 26 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:02.248843+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:02.250971+0000 mon.b (mon.2) 42 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T09:02:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:02.251909+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:02.253548+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-10T09:02:03.870 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:02.250497+0000 mgr.y (mgr.25069) 27 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-10T09:02:03.870 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:02.253145+0000 mgr.y (mgr.25069) 28 : cephadm [INF] Reconfiguring daemon osd.1 on smithi040 2024-02-10T09:02:03.870 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:03.653837+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:03.870 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:03.655427+0000 mon.b (mon.2) 45 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T09:02:03.870 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:02.250497+0000 mgr.y (mgr.25069) 27 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-10T09:02:03.870 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:02.253145+0000 mgr.y (mgr.25069) 28 : cephadm [INF] Reconfiguring daemon osd.1 on smithi040 2024-02-10T09:02:03.871 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:03.653837+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:03.871 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:03.655427+0000 mon.b (mon.2) 45 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T09:02:03.871 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:03.656223+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:03.871 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:03.657964+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-10T09:02:04.118 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:03.656223+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:04.118 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:03.657964+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-10T09:02:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:02.250497+0000 mgr.y (mgr.25069) 27 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-10T09:02:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:02.253145+0000 mgr.y (mgr.25069) 28 : cephadm [INF] Reconfiguring daemon osd.1 on smithi040 2024-02-10T09:02:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:03.653837+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:03.655427+0000 mon.b (mon.2) 45 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T09:02:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:03.656223+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:03.657964+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-10T09:02:05.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:03.386281+0000 mgr.y (mgr.25069) 29 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:05.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:03.655168+0000 mgr.y (mgr.25069) 30 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-10T09:02:05.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:03.657411+0000 mgr.y (mgr.25069) 31 : cephadm [INF] Reconfiguring daemon osd.2 on smithi040 2024-02-10T09:02:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:03.386281+0000 mgr.y (mgr.25069) 29 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:03.655168+0000 mgr.y (mgr.25069) 30 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-10T09:02:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:03.657411+0000 mgr.y (mgr.25069) 31 : cephadm [INF] Reconfiguring daemon osd.2 on smithi040 2024-02-10T09:02:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:03.386281+0000 mgr.y (mgr.25069) 29 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:03.655168+0000 mgr.y (mgr.25069) 30 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-10T09:02:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:03.657411+0000 mgr.y (mgr.25069) 31 : cephadm [INF] Reconfiguring daemon osd.2 on smithi040 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:05.083264+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:05.086572+0000 mgr.y (mgr.25069) 32 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:05.087063+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:05.088236+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:05.089505+0000 mgr.y (mgr.25069) 33 : cephadm [INF] Reconfiguring daemon osd.3 on smithi040 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:05.089938+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:05.083264+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:05.086572+0000 mgr.y (mgr.25069) 32 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-10T09:02:06.348 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:05.087063+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T09:02:06.349 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:05.088236+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:06.349 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:05.089505+0000 mgr.y (mgr.25069) 33 : cephadm [INF] Reconfiguring daemon osd.3 on smithi040 2024-02-10T09:02:06.349 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:05.089938+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-10T09:02:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:05.083264+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:05.086572+0000 mgr.y (mgr.25069) 32 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-10T09:02:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:05.087063+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T09:02:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:05.088236+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:05.089505+0000 mgr.y (mgr.25069) 33 : cephadm [INF] Reconfiguring daemon osd.3 on smithi040 2024-02-10T09:02:06.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:05.089938+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-10T09:02:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:05.386607+0000 mgr.y (mgr.25069) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.423588+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.425759+0000 mon.b (mon.2) 51 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.426311+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.427381+0000 mon.b (mon.2) 52 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.427807+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.430739+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.437115+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.438261+0000 mon.b (mon.2) 53 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.438920+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:06.440020+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi040.skjeib","key": "container_image"}]: dispatch 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:05.386607+0000 mgr.y (mgr.25069) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.423588+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.425759+0000 mon.b (mon.2) 51 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.426311+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.427381+0000 mon.b (mon.2) 52 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.427807+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.430739+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.437115+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.438261+0000 mon.b (mon.2) 53 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.438920+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:07.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:06.440020+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi040.skjeib","key": "container_image"}]: dispatch 2024-02-10T09:02:07.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:05.386607+0000 mgr.y (mgr.25069) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.423588+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.425759+0000 mon.b (mon.2) 51 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.426311+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.427381+0000 mon.b (mon.2) 52 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.427807+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.430739+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.437115+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.438261+0000 mon.b (mon.2) 53 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.438920+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:07.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:06.440020+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi040.skjeib","key": "container_image"}]: dispatch 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:06.425338+0000 mgr.y (mgr.25069) 35 : cephadm [INF] Reconfiguring rgw.r.z.smithi040.skjeib (monmap changed)... 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:06.433629+0000 mgr.y (mgr.25069) 36 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi040.skjeib 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:06.439583+0000 mgr.y (mgr.25069) 37 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:07.732730+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:07.734421+0000 mon.b (mon.2) 56 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:07.735232+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:02:08.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:07.735995+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:08.349 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:07.737069+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T09:02:08.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:06.425338+0000 mgr.y (mgr.25069) 35 : cephadm [INF] Reconfiguring rgw.r.z.smithi040.skjeib (monmap changed)... 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:06.433629+0000 mgr.y (mgr.25069) 36 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi040.skjeib 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:06.439583+0000 mgr.y (mgr.25069) 37 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:07.732730+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:07.734421+0000 mon.b (mon.2) 56 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:07.735232+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:07.735995+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:07.737069+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:06.425338+0000 mgr.y (mgr.25069) 35 : cephadm [INF] Reconfiguring rgw.r.z.smithi040.skjeib (monmap changed)... 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:06.433629+0000 mgr.y (mgr.25069) 36 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi040.skjeib 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:06.439583+0000 mgr.y (mgr.25069) 37 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:07.732730+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:08.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:07.734421+0000 mon.b (mon.2) 56 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-10T09:02:08.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:07.735232+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-10T09:02:08.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:07.735995+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:08.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:07.737069+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-10T09:02:09.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:07.387262+0000 mgr.y (mgr.25069) 38 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:09.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:07.734154+0000 mgr.y (mgr.25069) 39 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T09:02:09.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:07.736626+0000 mgr.y (mgr.25069) 40 : cephadm [INF] Reconfiguring daemon mon.b on smithi145 2024-02-10T09:02:09.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:09.086518+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:09.098 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:09.088312+0000 mon.b (mon.2) 60 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:02:09.099 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:09.088950+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:02:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:07.387262+0000 mgr.y (mgr.25069) 38 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:07.734154+0000 mgr.y (mgr.25069) 39 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T09:02:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:07.736626+0000 mgr.y (mgr.25069) 40 : cephadm [INF] Reconfiguring daemon mon.b on smithi145 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:09.086518+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:09.088312+0000 mon.b (mon.2) 60 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:09.088950+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:09.090073+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:09.090894+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:09.092042+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:07.387262+0000 mgr.y (mgr.25069) 38 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:07.734154+0000 mgr.y (mgr.25069) 39 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:07.736626+0000 mgr.y (mgr.25069) 40 : cephadm [INF] Reconfiguring daemon mon.b on smithi145 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:09.086518+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:09.088312+0000 mon.b (mon.2) 60 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:02:09.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:09.088950+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-10T09:02:09.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:09.090073+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T09:02:09.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:09.090894+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:09.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:09.092042+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-10T09:02:09.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:09.090073+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-10T09:02:09.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:09.090894+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:09.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:09.092042+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-10T09:02:10.370 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:09.087965+0000 mgr.y (mgr.25069) 41 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-10T09:02:10.370 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:09.091598+0000 mgr.y (mgr.25069) 42 : cephadm [INF] Reconfiguring daemon mgr.x on smithi145 2024-02-10T09:02:10.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:09.087965+0000 mgr.y (mgr.25069) 41 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-10T09:02:10.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:09.091598+0000 mgr.y (mgr.25069) 42 : cephadm [INF] Reconfiguring daemon mgr.x on smithi145 2024-02-10T09:02:10.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:09.087965+0000 mgr.y (mgr.25069) 41 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-10T09:02:10.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:09.091598+0000 mgr.y (mgr.25069) 42 : cephadm [INF] Reconfiguring daemon mgr.x on smithi145 2024-02-10T09:02:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:09.387645+0000 mgr.y (mgr.25069) 43 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:10.428164+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:10.429961+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T09:02:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:10.430758+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:10.432505+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-10T09:02:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:09.387645+0000 mgr.y (mgr.25069) 43 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:10.428164+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:10.429961+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T09:02:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:10.430758+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:11.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:10.432505+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-10T09:02:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:09.387645+0000 mgr.y (mgr.25069) 43 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:10.428164+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:10.429961+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T09:02:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:10.430758+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:10.432505+0000 mon.b (mon.2) 66 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-10T09:02:12.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:10.429638+0000 mgr.y (mgr.25069) 44 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-10T09:02:12.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:10.432072+0000 mgr.y (mgr.25069) 45 : cephadm [INF] Reconfiguring daemon osd.4 on smithi145 2024-02-10T09:02:12.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:11.900296+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:12.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:11.902149+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T09:02:12.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:11.903443+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:12.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:11.905257+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-10T09:02:12.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:10.429638+0000 mgr.y (mgr.25069) 44 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-10T09:02:12.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:10.432072+0000 mgr.y (mgr.25069) 45 : cephadm [INF] Reconfiguring daemon osd.4 on smithi145 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:11.900296+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:11.902149+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:11.903443+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:11.905257+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:10.429638+0000 mgr.y (mgr.25069) 44 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:10.432072+0000 mgr.y (mgr.25069) 45 : cephadm [INF] Reconfiguring daemon osd.4 on smithi145 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:11.900296+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:11.902149+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:11.903443+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:12.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:11.905257+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-10T09:02:13.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:11.388024+0000 mgr.y (mgr.25069) 46 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:13.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:11.901683+0000 mgr.y (mgr.25069) 47 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-10T09:02:13.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:11.904785+0000 mgr.y (mgr.25069) 48 : cephadm [INF] Reconfiguring daemon osd.5 on smithi145 2024-02-10T09:02:13.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:11.388024+0000 mgr.y (mgr.25069) 46 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:11.901683+0000 mgr.y (mgr.25069) 47 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-10T09:02:13.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:11.904785+0000 mgr.y (mgr.25069) 48 : cephadm [INF] Reconfiguring daemon osd.5 on smithi145 2024-02-10T09:02:13.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:11.388024+0000 mgr.y (mgr.25069) 46 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:13.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:11.901683+0000 mgr.y (mgr.25069) 47 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-10T09:02:13.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:11.904785+0000 mgr.y (mgr.25069) 48 : cephadm [INF] Reconfiguring daemon osd.5 on smithi145 2024-02-10T09:02:14.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:13.304431+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:14.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:13.305831+0000 mgr.y (mgr.25069) 49 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-10T09:02:14.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:13.306272+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T09:02:14.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:13.307484+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:14.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:13.308846+0000 mgr.y (mgr.25069) 50 : cephadm [INF] Reconfiguring daemon osd.6 on smithi145 2024-02-10T09:02:14.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:13.309368+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-10T09:02:14.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:13.388681+0000 mgr.y (mgr.25069) 51 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:14.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:13.304431+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:13.305831+0000 mgr.y (mgr.25069) 49 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:13.306272+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:13.307484+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:13.308846+0000 mgr.y (mgr.25069) 50 : cephadm [INF] Reconfiguring daemon osd.6 on smithi145 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:13.309368+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:13.388681+0000 mgr.y (mgr.25069) 51 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:13.304431+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:13.305831+0000 mgr.y (mgr.25069) 49 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:13.306272+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:13.307484+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:14.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:13.308846+0000 mgr.y (mgr.25069) 50 : cephadm [INF] Reconfiguring daemon osd.6 on smithi145 2024-02-10T09:02:14.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:13.309368+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-10T09:02:14.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:13.388681+0000 mgr.y (mgr.25069) 51 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:15.988 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:14.694609+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:15.988 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:14.696088+0000 mgr.y (mgr.25069) 52 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-10T09:02:15.988 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:14.696503+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T09:02:15.989 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:14.697472+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:15.989 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:14.698779+0000 mgr.y (mgr.25069) 53 : cephadm [INF] Reconfiguring daemon osd.7 on smithi145 2024-02-10T09:02:15.989 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:14.699244+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-10T09:02:16.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:14.694609+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:14.696088+0000 mgr.y (mgr.25069) 52 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:14.696503+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:14.697472+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:14.698779+0000 mgr.y (mgr.25069) 53 : cephadm [INF] Reconfiguring daemon osd.7 on smithi145 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:14.699244+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:14.694609+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:14.696088+0000 mgr.y (mgr.25069) 52 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-10T09:02:16.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:14.696503+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T09:02:16.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:14.697472+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:16.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:14.698779+0000 mgr.y (mgr.25069) 53 : cephadm [INF] Reconfiguring daemon osd.7 on smithi145 2024-02-10T09:02:16.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:14.699244+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-10T09:02:17.353 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:15.389206+0000 mgr.y (mgr.25069) 54 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:17.353 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.061308+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:17.353 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:16.063039+0000 mgr.y (mgr.25069) 55 : cephadm [INF] Reconfiguring rgw.r.z.smithi145.uizklq (monmap changed)... 2024-02-10T09:02:17.353 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.063314+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.063718+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.064963+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.065384+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.068745+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:16.069600+0000 mgr.y (mgr.25069) 56 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi145.uizklq 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.073740+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.074627+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.075389+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:16.076183+0000 mgr.y (mgr.25069) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T09:02:17.354 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:16.076559+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi145.uizklq","key": "container_image"}]: dispatch 2024-02-10T09:02:17.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:15.389206+0000 mgr.y (mgr.25069) 54 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.061308+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:16.063039+0000 mgr.y (mgr.25069) 55 : cephadm [INF] Reconfiguring rgw.r.z.smithi145.uizklq (monmap changed)... 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.063314+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.063718+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.064963+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.065384+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.068745+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:16.069600+0000 mgr.y (mgr.25069) 56 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi145.uizklq 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.073740+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.074627+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.075389+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:17.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:16.076183+0000 mgr.y (mgr.25069) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:16.076559+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi145.uizklq","key": "container_image"}]: dispatch 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:15.389206+0000 mgr.y (mgr.25069) 54 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.061308+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:16.063039+0000 mgr.y (mgr.25069) 55 : cephadm [INF] Reconfiguring rgw.r.z.smithi145.uizklq (monmap changed)... 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.063314+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.063718+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.064963+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.065384+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.068745+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:16.069600+0000 mgr.y (mgr.25069) 56 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi145.uizklq 2024-02-10T09:02:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.073740+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:17.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.074627+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:02:17.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.075389+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:17.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:16.076183+0000 mgr.y (mgr.25069) 57 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T09:02:17.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:16.076559+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi145.uizklq","key": "container_image"}]: dispatch 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:17.390036+0000 mgr.y (mgr.25069) 58 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.395985+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.398794+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.402427+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.404120+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.404902+0000 mgr.y (mgr.25069) 59 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.411627+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.412757+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.413150+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.418558+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.419462+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.419881+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.425531+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.427102+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.427978+0000 mgr.y (mgr.25069) 60 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.434472+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:17.390036+0000 mgr.y (mgr.25069) 58 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.395985+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.398794+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.402427+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.404120+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.404902+0000 mgr.y (mgr.25069) 59 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.411627+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.412757+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.413150+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.418558+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.419462+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.419881+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.425531+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.427102+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.427978+0000 mgr.y (mgr.25069) 60 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:02:18.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.434472+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.436499+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.437325+0000 mgr.y (mgr.25069) 61 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.441682+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.444377+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.445175+0000 mgr.y (mgr.25069) 62 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.449622+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.450997+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.451811+0000 mgr.y (mgr.25069) 63 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.453164+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.453511+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.454433+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.454736+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.455940+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.456613+0000 mgr.y (mgr.25069) 64 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.460816+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.463496+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.464209+0000 mgr.y (mgr.25069) 65 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.468252+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.436499+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.437325+0000 mgr.y (mgr.25069) 61 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:02:18.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.441682+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.444377+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.445175+0000 mgr.y (mgr.25069) 62 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.449622+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.450997+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.451811+0000 mgr.y (mgr.25069) 63 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.453164+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.453511+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.454433+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.454736+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.455940+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.456613+0000 mgr.y (mgr.25069) 64 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.460816+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.463496+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.464209+0000 mgr.y (mgr.25069) 65 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:02:18.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.468252+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.469651+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.470334+0000 mgr.y (mgr.25069) 66 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.471597+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.471904+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.472566+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.472846+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.474137+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.474783+0000 mgr.y (mgr.25069) 67 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.476189+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.476587+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.477342+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.477643+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.478975+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.479669+0000 mgr.y (mgr.25069) 68 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.481099+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.481461+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.469651+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.470334+0000 mgr.y (mgr.25069) 66 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.471597+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.471904+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.472566+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.472846+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.474137+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.474783+0000 mgr.y (mgr.25069) 67 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.476189+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.476587+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.477342+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.477643+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.478975+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.479669+0000 mgr.y (mgr.25069) 68 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.481099+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.481461+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.482238+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.482555+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.483818+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.484480+0000 mgr.y (mgr.25069) 69 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.486094+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.486355+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.487140+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.487390+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.487994+0000 mgr.y (mgr.25069) 70 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.489282+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.489553+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.493392+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.494979+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.495263+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.498847+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.482238+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.482555+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.483818+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.484480+0000 mgr.y (mgr.25069) 69 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.486094+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.486355+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.487140+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.487390+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.487994+0000 mgr.y (mgr.25069) 70 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.489282+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.489553+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.493392+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:02:18.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.494979+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.495263+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.498847+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.499655+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.499987+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.503502+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.505642+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.505961+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.506677+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.506952+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.510522+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:02:18.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.511418+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.511720+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.512567+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.512944+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.516434+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.517189+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.517461+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.499655+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.499987+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.503502+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:02:18.688 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.505642+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.505961+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.506677+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.506952+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.510522+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.511418+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.511720+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.512567+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.512944+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.516434+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.517189+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.689 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.517461+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.518104+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.518390+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.521916+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.522676+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.522984+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.526488+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.527209+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.527510+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.528229+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.528506+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.529174+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.529415+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.530026+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.690 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.530272+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.518104+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.518390+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.521916+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.522676+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.522984+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.526488+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.527209+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.527510+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.528229+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.528506+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.691 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.529174+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.529415+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.530026+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.530272+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.530935+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.531215+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.534712+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:17.535352+0000 mgr.y (mgr.25069) 71 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.535862+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.536301+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:02:18.692 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.538438+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.776460+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.780907+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:17.788897+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.530935+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.531215+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.534712+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:17.535352+0000 mgr.y (mgr.25069) 71 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.535862+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.536301+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.538438+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.776460+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.780907+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.693 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:17.788897+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:17.390036+0000 mgr.y (mgr.25069) 58 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.395985+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.398794+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.402427+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.404120+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.404902+0000 mgr.y (mgr.25069) 59 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.411627+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.412757+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.413150+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.418558+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.419462+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.419881+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.425531+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.427102+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.427978+0000 mgr.y (mgr.25069) 60 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.434472+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.436499+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.437325+0000 mgr.y (mgr.25069) 61 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.441682+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.444377+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.445175+0000 mgr.y (mgr.25069) 62 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.449622+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.450997+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.451811+0000 mgr.y (mgr.25069) 63 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.453164+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.453511+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.454433+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.454736+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.455940+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.456613+0000 mgr.y (mgr.25069) 64 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.460816+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.463496+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.464209+0000 mgr.y (mgr.25069) 65 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.468252+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.469651+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.470334+0000 mgr.y (mgr.25069) 66 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.471597+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.471904+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.472566+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.472846+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.474137+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.474783+0000 mgr.y (mgr.25069) 67 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.476189+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.476587+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.477342+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.477643+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.478975+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.479669+0000 mgr.y (mgr.25069) 68 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.481099+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.481461+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.482238+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.482555+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.483818+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.484480+0000 mgr.y (mgr.25069) 69 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.486094+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.486355+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.487140+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.487390+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.487994+0000 mgr.y (mgr.25069) 70 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.489282+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.489553+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.493392+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.494979+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.495263+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.498847+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.499655+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:02:18.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.499987+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.503502+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.505642+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.505961+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.506677+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.506952+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.510522+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.511418+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.511720+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.512567+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.512944+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.516434+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.517189+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.517461+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.518104+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.518390+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.521916+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.522676+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.522984+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.526488+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.527209+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.527510+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.528229+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.528506+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.529174+0000 mon.b (mon.2) 118 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.529415+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.530026+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.530272+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.530935+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:02:18.789 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.531215+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.534712+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:17.535352+0000 mgr.y (mgr.25069) 71 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.535862+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.536301+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.538438+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.776460+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.780907+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:18.790 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:17.788897+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:20.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:19.390724+0000 mgr.y (mgr.25069) 72 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:20.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:19.390724+0000 mgr.y (mgr.25069) 72 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:20.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:19.390724+0000 mgr.y (mgr.25069) 72 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:22.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:21.391234+0000 mgr.y (mgr.25069) 73 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:22.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:21.560869+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:22.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:21.391234+0000 mgr.y (mgr.25069) 73 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:22.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:21.560869+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:21.391234+0000 mgr.y (mgr.25069) 73 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:21.560869+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:24.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:02:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:23.392095+0000 mgr.y (mgr.25069) 74 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:24.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:23.997544+0000 mgr.y (mgr.25069) 75 : audit [DBG] from='client.54159 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:23.392095+0000 mgr.y (mgr.25069) 74 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:23.997544+0000 mgr.y (mgr.25069) 75 : audit [DBG] from='client.54159 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:25.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:23.392095+0000 mgr.y (mgr.25069) 74 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:25.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:23.997544+0000 mgr.y (mgr.25069) 75 : audit [DBG] from='client.54159 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:26.635 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (2m) 29s ago 26m 14.7M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (2m) 40s ago 25m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (3m) 40s ago 29m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (12m) 29s ago 31m 412M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (64s) 29s ago 31m 40.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (109s) 40s ago 29m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (35s) 29s ago 30m 26.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (3m) 29s ago 26m 14.8M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (3m) 40s ago 26m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (29m) 29s ago 29m 49.2M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T09:02:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (28m) 29s ago 28m 46.5M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (28m) 29s ago 28m 45.8M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (28m) 29s ago 28m 50.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (27m) 40s ago 27m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (27m) 40s ago 27m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (27m) 40s ago 27m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (26m) 40s ago 26m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (2m) 40s ago 26m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (24m) 29s ago 24m 40.1M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:02:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (24m) 40s ago 24m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:25.392517+0000 mgr.y (mgr.25069) 76 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.623242+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.624015+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.624528+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.624986+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.625387+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.625835+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.627663+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.628178+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.628574+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.628994+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.629641+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:25.392517+0000 mgr.y (mgr.25069) 76 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.623242+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.624015+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.624528+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.624986+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.625387+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.625835+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.627663+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.628178+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.628574+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.628994+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:26.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.629641+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:25.392517+0000 mgr.y (mgr.25069) 76 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.623242+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.624015+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.624528+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.624986+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.625387+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.625835+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.627663+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:27.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.628178+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.628574+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.628994+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.629641+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:27.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 1'"'"'' 2024-02-10T09:02:28.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:26.621362+0000 mgr.y (mgr.25069) 77 : audit [DBG] from='client.54165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:28.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:26.621362+0000 mgr.y (mgr.25069) 77 : audit [DBG] from='client.54165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:26.621362+0000 mgr.y (mgr.25069) 77 : audit [DBG] from='client.54165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:28.804 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:27.393121+0000 mgr.y (mgr.25069) 78 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:28.805 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:27.393121+0000 mgr.y (mgr.25069) 78 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:29.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:27.393121+0000 mgr.y (mgr.25069) 78 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:02:29.992 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:29.334310+0000 mon.a (mon.0) 134 : audit [DBG] from='client.54171 172.21.15.40:0/757502419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:29.993 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:29.334310+0000 mon.a (mon.0) 134 : audit [DBG] from='client.54171 172.21.15.40:0/757502419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:30.004 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.mon | keys'"'"' | grep $sha1' 2024-02-10T09:02:30.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:29.334310+0000 mon.a (mon.0) 134 : audit [DBG] from='client.54171 172.21.15.40:0/757502419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:31.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:29.393415+0000 mgr.y (mgr.25069) 79 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:29.393415+0000 mgr.y (mgr.25069) 79 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:31.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:29.393415+0000 mgr.y (mgr.25069) 79 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:32.011 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-10T09:02:32.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 5'"'"'' 2024-02-10T09:02:32.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:31.393951+0000 mgr.y (mgr.25069) 80 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:32.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:32.000155+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.15.40:0/2861649897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:32.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:31.393951+0000 mgr.y (mgr.25069) 80 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:32.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:32.000155+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.15.40:0/2861649897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:33.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:31.393951+0000 mgr.y (mgr.25069) 80 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:33.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:32.000155+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.15.40:0/2861649897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:35.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:33.394547+0000 mgr.y (mgr.25069) 81 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:35.123 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:33.394547+0000 mgr.y (mgr.25069) 81 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:35.123 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:33.394547+0000 mgr.y (mgr.25069) 81 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:35.749 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:34.397157+0000 mgr.y (mgr.25069) 82 : audit [DBG] from='client.54183 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:35.781 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:02:36.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:34.397157+0000 mgr.y (mgr.25069) 82 : audit [DBG] from='client.54183 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:36.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:34.397157+0000 mgr.y (mgr.25069) 82 : audit [DBG] from='client.54183 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:36.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2' 2024-02-10T09:02:36.871 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:35.394966+0000 mgr.y (mgr.25069) 83 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:36.872 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:35.394966+0000 mgr.y (mgr.25069) 83 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:35.394966+0000 mgr.y (mgr.25069) 83 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:37.395604+0000 mgr.y (mgr.25069) 84 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:39.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:37.395604+0000 mgr.y (mgr.25069) 84 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:39.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:37.395604+0000 mgr.y (mgr.25069) 84 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:39.826 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:38.475278+0000 mgr.y (mgr.25069) 85 : audit [DBG] from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:39.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:38.475278+0000 mgr.y (mgr.25069) 85 : audit [DBG] from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:39.852 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:40.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:38.475278+0000 mgr.y (mgr.25069) 85 : audit [DBG] from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:40.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:39.395910+0000 mgr.y (mgr.25069) 86 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:39.846122+0000 mgr.y (mgr.25069) 87 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:39.851490+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:39.860112+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:39.866106+0000 mgr.y (mgr.25069) 88 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:39.395910+0000 mgr.y (mgr.25069) 86 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:41.048 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:39.846122+0000 mgr.y (mgr.25069) 87 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:41.049 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:39.851490+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:41.049 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:39.860112+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:41.049 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:39.866106+0000 mgr.y (mgr.25069) 88 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:39.395910+0000 mgr.y (mgr.25069) 86 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:39.846122+0000 mgr.y (mgr.25069) 87 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:41.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:39.851490+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:41.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:39.860112+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:41.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:39.866106+0000 mgr.y (mgr.25069) 88 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:02:42.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.412133+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:02:42.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.412444+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.412546+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:02:42.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.412759+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.412888+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.413102+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.413128+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-10T09:02:42.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:41.413477+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.412133+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.412444+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.412546+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.412759+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.412888+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.413102+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.413128+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-10T09:02:42.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:41.413477+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-10T09:02:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.412133+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:02:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.412444+0000 mon.b (mon.2) 134 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.412546+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:02:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.412759+0000 mon.b (mon.2) 135 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.412888+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.413102+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-10T09:02:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.413128+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-10T09:02:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:41.413477+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2024-02-10T09:02:42.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:41.396462+0000 mgr.y (mgr.25069) 89 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:42.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.334953+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.338124+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:42.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.344948+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.347097+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.353121+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.355340+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.361369+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.363293+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.369105+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.371256+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-10T09:02:42.906 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:41.396462+0000 mgr.y (mgr.25069) 89 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.334953+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.338124+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.344948+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.347097+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.353121+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.355340+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.361369+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.907 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.363293+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:42.908 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.369105+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:42.908 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.371256+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-10T09:02:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:41.396462+0000 mgr.y (mgr.25069) 89 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.334953+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.338124+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.344948+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.347097+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.353121+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.355340+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.361369+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.363293+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.369105+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.371256+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-10T09:02:43.349 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:02:43.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:42.336710+0000 mgr.y (mgr.25069) 90 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:02:43.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:42.336838+0000 mgr.y (mgr.25069) 91 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:42.347873+0000 mgr.y (mgr.25069) 92 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:42.356095+0000 mgr.y (mgr.25069) 93 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:42.364024+0000 mgr.y (mgr.25069) 94 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:42.371486+0000 mgr.y (mgr.25069) 95 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:42.372497+0000 mgr.y (mgr.25069) 96 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:42.336710+0000 mgr.y (mgr.25069) 90 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:42.336838+0000 mgr.y (mgr.25069) 91 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:42.347873+0000 mgr.y (mgr.25069) 92 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:42.356095+0000 mgr.y (mgr.25069) 93 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:42.364024+0000 mgr.y (mgr.25069) 94 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:42.371486+0000 mgr.y (mgr.25069) 95 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-10T09:02:43.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:42.372497+0000 mgr.y (mgr.25069) 96 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-10T09:02:44.011 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:02:44.011 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (3m) 47s ago 26m 14.7M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (2m) 57s ago 26m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (3m) 57s ago 29m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (13m) 47s ago 31m 412M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (81s) 47s ago 31m 40.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (2m) 57s ago 30m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (52s) 47s ago 30m 26.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (3m) 47s ago 26m 14.8M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (3m) 57s ago 26m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (29m) 47s ago 29m 49.2M 4096M 15.2.0 204a01f9b0b6 f1d32c2ff24b 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (29m) 47s ago 29m 46.5M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (28m) 47s ago 28m 45.8M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (28m) 47s ago 28m 50.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:02:44.012 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (28m) 57s ago 28m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:02:44.013 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (27m) 57s ago 27m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:02:44.013 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (27m) 57s ago 27m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:02:44.013 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (27m) 57s ago 27m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:02:44.013 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (3m) 57s ago 26m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:02:44.013 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (24m) 47s ago 24m 40.1M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:02:44.013 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (24m) 57s ago 24m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:02:44.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:42.336710+0000 mgr.y (mgr.25069) 90 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:02:44.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:42.336838+0000 mgr.y (mgr.25069) 91 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:02:44.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:42.347873+0000 mgr.y (mgr.25069) 92 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:02:44.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:42.356095+0000 mgr.y (mgr.25069) 93 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:02:44.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:42.364024+0000 mgr.y (mgr.25069) 94 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:02:44.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:42.371486+0000 mgr.y (mgr.25069) 95 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-10T09:02:44.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:42.372497+0000 mgr.y (mgr.25069) 96 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-10T09:02:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:02:44.413 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:02:44.413 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:02:44.413 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:02:44.413 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:02:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:02:44.755 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (2 remaining).", 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "0/8 daemons upgraded", 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:02:44.756 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:02:45.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:43.337650+0000 mgr.y (mgr.25069) 97 : audit [DBG] from='client.54195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:43.397233+0000 mgr.y (mgr.25069) 98 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:43.675837+0000 mgr.y (mgr.25069) 99 : audit [DBG] from='client.54201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:43.998323+0000 mgr.y (mgr.25069) 100 : audit [DBG] from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.000409+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.001127+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.001508+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.002229+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.002717+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.003080+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.004905+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.005340+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.005717+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.006068+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:43.337650+0000 mgr.y (mgr.25069) 97 : audit [DBG] from='client.54195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:43.397233+0000 mgr.y (mgr.25069) 98 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:43.675837+0000 mgr.y (mgr.25069) 99 : audit [DBG] from='client.54201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:43.998323+0000 mgr.y (mgr.25069) 100 : audit [DBG] from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.000409+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.001127+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.001508+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.002229+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.002717+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.003080+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.004905+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.005340+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.005717+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.006068+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.006445+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.332501+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.334179+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.334885+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.337255+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-10T09:02:45.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.413467+0000 mon.c (mon.1) 3 : audit [DBG] from='client.64156 172.21.15.40:0/2345009106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.006445+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.332501+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.334179+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T09:02:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.334885+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.337255+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-10T09:02:45.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.413467+0000 mon.c (mon.1) 3 : audit [DBG] from='client.64156 172.21.15.40:0/2345009106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:43.337650+0000 mgr.y (mgr.25069) 97 : audit [DBG] from='client.54195 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:43.397233+0000 mgr.y (mgr.25069) 98 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:43.675837+0000 mgr.y (mgr.25069) 99 : audit [DBG] from='client.54201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:43.998323+0000 mgr.y (mgr.25069) 100 : audit [DBG] from='client.64150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.000409+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.001127+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.001508+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.002229+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.002717+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.003080+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.004905+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.005340+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.005717+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.006068+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.006445+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.332501+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.334179+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-10T09:02:45.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.334885+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:02:45.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.337255+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-10T09:02:45.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.413467+0000 mon.c (mon.1) 3 : audit [DBG] from='client.64156 172.21.15.40:0/2345009106' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:46.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:44.327853+0000 mgr.y (mgr.25069) 101 : cephadm [INF] Upgrade: Updating osd.0 2024-02-10T09:02:46.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:44.336520+0000 mgr.y (mgr.25069) 102 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-10T09:02:46.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:44.755596+0000 mgr.y (mgr.25069) 103 : audit [DBG] from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:46.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:44.327853+0000 mgr.y (mgr.25069) 101 : cephadm [INF] Upgrade: Updating osd.0 2024-02-10T09:02:46.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:44.336520+0000 mgr.y (mgr.25069) 102 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-10T09:02:46.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:44.755596+0000 mgr.y (mgr.25069) 103 : audit [DBG] from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:44.327853+0000 mgr.y (mgr.25069) 101 : cephadm [INF] Upgrade: Updating osd.0 2024-02-10T09:02:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:44.336520+0000 mgr.y (mgr.25069) 102 : cephadm [INF] Deploying daemon osd.0 on smithi040 2024-02-10T09:02:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:44.755596+0000 mgr.y (mgr.25069) 103 : audit [DBG] from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:02:47.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:45.397582+0000 mgr.y (mgr.25069) 104 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:47.089 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:46 smithi040 systemd[1]: Stopping Ceph osd.0 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:02:47.089 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:45.397582+0000 mgr.y (mgr.25069) 104 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:47.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:45.397582+0000 mgr.y (mgr.25069) 104 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:47.416 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:47 smithi040 bash[41300]: debug 2024-02-10T09:02:47.087+0000 7ff2b382c700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:02:47.417 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:47 smithi040 bash[41300]: debug 2024-02-10T09:02:47.087+0000 7ff2b382c700 -1 osd.0 66 *** Got signal Terminated *** 2024-02-10T09:02:47.417 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:47 smithi040 bash[41300]: debug 2024-02-10T09:02:47.087+0000 7ff2b382c700 -1 osd.0 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:02:47.675 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:47 smithi040 bash[78310]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.0 2024-02-10T09:02:48.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.131596+0000 mon.a (mon.0) 148 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.131622+0000 mon.a (mon.0) 149 : cluster [INF] osd.0 failed (root=default,host=smithi040) (connection refused reported by osd.6) 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.131795+0000 mon.a (mon.0) 150 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.131876+0000 mon.a (mon.0) 151 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.332444+0000 mon.a (mon.0) 152 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.332510+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.332637+0000 mon.a (mon.0) 154 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.332690+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.332808+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.332915+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333046+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333130+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333263+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333371+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333453+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333597+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333709+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.333815+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.732364+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.732577+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.131596+0000 mon.a (mon.0) 148 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.131622+0000 mon.a (mon.0) 149 : cluster [INF] osd.0 failed (root=default,host=smithi040) (connection refused reported by osd.6) 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.131795+0000 mon.a (mon.0) 150 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.131876+0000 mon.a (mon.0) 151 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.332444+0000 mon.a (mon.0) 152 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.332510+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.332637+0000 mon.a (mon.0) 154 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.332690+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.332808+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.332915+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333046+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333130+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333263+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333371+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333453+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333597+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333709+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.333815+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.732364+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.732577+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.733374+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.733541+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.733727+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.733876+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.734020+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.734226+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.734371+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.734560+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.734742+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.734912+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.735034+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.735154+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.733374+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.733541+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.733727+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.733876+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.734020+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.734226+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.734371+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.734560+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.734742+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.734912+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.735034+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.735154+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.131596+0000 mon.a (mon.0) 148 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.131622+0000 mon.a (mon.0) 149 : cluster [INF] osd.0 failed (root=default,host=smithi040) (connection refused reported by osd.6) 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.131795+0000 mon.a (mon.0) 150 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.131876+0000 mon.a (mon.0) 151 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.332444+0000 mon.a (mon.0) 152 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.332510+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.332637+0000 mon.a (mon.0) 154 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.332690+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.332808+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.332915+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333046+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333130+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333263+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333371+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333453+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333597+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333709+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.333815+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.732364+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.732577+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.733374+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.733541+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.733727+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.733876+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.734020+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.734226+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.734371+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.734560+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.734742+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.734912+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-10T09:02:48.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.735034+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.735154+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-10T09:02:48.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.398202+0000 mgr.y (mgr.25069) 105 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:48.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.872450+0000 mon.a (mon.0) 180 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:02:48.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:47.880281+0000 mon.a (mon.0) 181 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-02-10T09:02:48.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:47.882617+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:47.886035+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:47.892865+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:47.893465+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.398202+0000 mgr.y (mgr.25069) 105 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.872450+0000 mon.a (mon.0) 180 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:47.880281+0000 mon.a (mon.0) 181 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:47.882617+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:47.886035+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T09:02:48.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:47.892865+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T09:02:48.892 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:47.893465+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.398202+0000 mgr.y (mgr.25069) 105 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.872450+0000 mon.a (mon.0) 180 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:47.880281+0000 mon.a (mon.0) 181 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:47.882617+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:47.886035+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:47.892865+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T09:02:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:47.893465+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-10T09:02:49.892 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:49 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.0.service: Succeeded. 2024-02-10T09:02:49.893 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:49 smithi040 systemd[1]: Stopped Ceph osd.0 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:02:49.893 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:49 smithi040 systemd[1]: Starting Ceph osd.0 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:02:50.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:48.882294+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T09:02:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:48.882374+0000 mon.a (mon.0) 185 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-02-10T09:02:50.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:48.882294+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T09:02:50.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:48.882374+0000 mon.a (mon.0) 185 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-02-10T09:02:50.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:48.882294+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-10T09:02:50.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:48.882374+0000 mon.a (mon.0) 185 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-10T09:02:50.894 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:50 smithi040 bash[78605]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-10T09:02:51.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:49.398685+0000 mgr.y (mgr.25069) 106 : cluster [DBG] pgmap v39: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:51.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:49.398685+0000 mgr.y (mgr.25069) 106 : cluster [DBG] pgmap v39: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:51.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:49.398685+0000 mgr.y (mgr.25069) 106 : cluster [DBG] pgmap v39: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:51.925 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:02:51.632+0000 7fc88d310700 1 -- 172.21.15.40:0/4171402311 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a379d62680 con 0x55a379d29400 2024-02-10T09:02:51.925 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:51 smithi040 bash[78872]: d22eb04aacbc7d08ecf63faa00ca70add81da2f25ac796fb738016942ab48ccc 2024-02-10T09:02:51.926 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:51 smithi040 systemd[1]: Started Ceph osd.0 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:02:52.425 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:02:52.151+0000 7fc894d9e380 -1 Falling back to public interface 2024-02-10T09:02:53.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:51.399159+0000 mgr.y (mgr.25069) 107 : cluster [DBG] pgmap v40: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:53.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:51.758144+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:53.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:51.763262+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:53.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:51.764666+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:02:53.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:51.399159+0000 mgr.y (mgr.25069) 107 : cluster [DBG] pgmap v40: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:51.758144+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:51.763262+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:51.764666+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:51.399159+0000 mgr.y (mgr.25069) 107 : cluster [DBG] pgmap v40: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:51.758144+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:51.763262+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:53.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:51.764666+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:02:54.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:53.757994+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: Degraded data redundancy: 67/609 objects degraded (11.002%), 21 pgs degraded (PG_DEGRADED) 2024-02-10T09:02:54.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:53.757994+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: Degraded data redundancy: 67/609 objects degraded (11.002%), 21 pgs degraded (PG_DEGRADED) 2024-02-10T09:02:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:53.757994+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: Degraded data redundancy: 67/609 objects degraded (11.002%), 21 pgs degraded (PG_DEGRADED) 2024-02-10T09:02:55.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:53.399905+0000 mgr.y (mgr.25069) 108 : cluster [DBG] pgmap v41: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:55.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:53.399905+0000 mgr.y (mgr.25069) 108 : cluster [DBG] pgmap v41: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:55.176 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:02:54.879+0000 7fc894d9e380 -1 osd.0 66 log_to_monitors {default=true} 2024-02-10T09:02:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:53.399905+0000 mgr.y (mgr.25069) 108 : cluster [DBG] pgmap v41: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:56.175 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:02:55.846+0000 7fc886285700 -1 osd.0 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:02:56.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:54.883793+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T09:02:56.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:54.884078+0000 mon.a (mon.0) 189 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T09:02:56.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.552711+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:56.176 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:02:55.872+0000 7f95858b4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-10T09:02:56.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:54.883793+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T09:02:56.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:54.884078+0000 mon.a (mon.0) 189 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T09:02:56.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.552711+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:54.883793+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T09:02:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:54.884078+0000 mon.a (mon.0) 189 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-10T09:02:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.552711+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:57.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:55.400313+0000 mgr.y (mgr.25069) 109 : cluster [DBG] pgmap v42: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.825259+0000 mon.a (mon.0) 191 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:55.825327+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.829201+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.829562+0000 mon.a (mon.0) 193 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.859202+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.866340+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.869418+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.870596+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.871551+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.872809+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:55.873032+0000 mgr.y (mgr.25069) 110 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:02:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:02:55.873727+0000 mgr.y (mgr.25069) 111 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:55.400313+0000 mgr.y (mgr.25069) 109 : cluster [DBG] pgmap v42: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.825259+0000 mon.a (mon.0) 191 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:55.825327+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.829201+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.829562+0000 mon.a (mon.0) 193 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.859202+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.866340+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.869418+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.870596+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.871551+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.872809+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:55.873032+0000 mgr.y (mgr.25069) 110 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:02:57.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:02:55.873727+0000 mgr.y (mgr.25069) 111 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-10T09:02:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:55.400313+0000 mgr.y (mgr.25069) 109 : cluster [DBG] pgmap v42: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.825259+0000 mon.a (mon.0) 191 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-10T09:02:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:55.825327+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2024-02-10T09:02:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.829201+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.829562+0000 mon.a (mon.0) 193 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.859202+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.866340+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.869418+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.870596+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.871551+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.872809+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:55.873032+0000 mgr.y (mgr.25069) 110 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:02:57.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:02:55.873727+0000 mgr.y (mgr.25069) 111 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-10T09:02:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:56.858127+0000 mon.a (mon.0) 195 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:02:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:56.862613+0000 mon.a (mon.0) 196 : cluster [INF] osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244] boot 2024-02-10T09:02:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:56.862667+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-10T09:02:58.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:02:56.863699+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T09:02:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:56.858127+0000 mon.a (mon.0) 195 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:02:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:56.862613+0000 mon.a (mon.0) 196 : cluster [INF] osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244] boot 2024-02-10T09:02:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:56.862667+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-10T09:02:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:02:56.863699+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T09:02:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:56.858127+0000 mon.a (mon.0) 195 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:02:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:56.862613+0000 mon.a (mon.0) 196 : cluster [INF] osd.0 [v2:172.21.15.40:6802/2370973244,v1:172.21.15.40:6803/2370973244] boot 2024-02-10T09:02:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:56.862667+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-10T09:02:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:02:56.863699+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-10T09:02:59.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:57.400927+0000 mgr.y (mgr.25069) 112 : cluster [DBG] pgmap v45: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:59.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:02:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:57.866565+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-10T09:02:59.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:57.400927+0000 mgr.y (mgr.25069) 112 : cluster [DBG] pgmap v45: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:59.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:02:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:57.866565+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-10T09:02:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:57.400927+0000 mgr.y (mgr.25069) 112 : cluster [DBG] pgmap v45: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:02:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:02:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:57.866565+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-10T09:03:01.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:02:59.401406+0000 mgr.y (mgr.25069) 113 : cluster [DBG] pgmap v47: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:03:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:02:59.401406+0000 mgr.y (mgr.25069) 113 : cluster [DBG] pgmap v47: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:03:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:02:59.401406+0000 mgr.y (mgr.25069) 113 : cluster [DBG] pgmap v47: 129 pgs: 21 active+undersized+degraded, 28 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/609 objects degraded (11.002%) 2024-02-10T09:03:02.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:01.870853+0000 mon.a (mon.0) 199 : cluster [WRN] Health check update: Degraded data redundancy: 38/609 objects degraded (6.240%), 13 pgs degraded (PG_DEGRADED) 2024-02-10T09:03:02.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:01.870853+0000 mon.a (mon.0) 199 : cluster [WRN] Health check update: Degraded data redundancy: 38/609 objects degraded (6.240%), 13 pgs degraded (PG_DEGRADED) 2024-02-10T09:03:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:01.870853+0000 mon.a (mon.0) 199 : cluster [WRN] Health check update: Degraded data redundancy: 38/609 objects degraded (6.240%), 13 pgs degraded (PG_DEGRADED) 2024-02-10T09:03:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:01.401941+0000 mgr.y (mgr.25069) 114 : cluster [DBG] pgmap v48: 129 pgs: 13 active+undersized+degraded, 20 active+undersized, 96 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:03:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:01.401941+0000 mgr.y (mgr.25069) 114 : cluster [DBG] pgmap v48: 129 pgs: 13 active+undersized+degraded, 20 active+undersized, 96 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:03:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:01.401941+0000 mgr.y (mgr.25069) 114 : cluster [DBG] pgmap v48: 129 pgs: 13 active+undersized+degraded, 20 active+undersized, 96 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:03:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:03.924798+0000 mon.a (mon.0) 200 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/609 objects degraded (6.240%), 13 pgs degraded) 2024-02-10T09:03:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:03.924877+0000 mon.a (mon.0) 201 : cluster [INF] Cluster is now healthy 2024-02-10T09:03:04.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:03.924798+0000 mon.a (mon.0) 200 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/609 objects degraded (6.240%), 13 pgs degraded) 2024-02-10T09:03:04.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:03.924877+0000 mon.a (mon.0) 201 : cluster [INF] Cluster is now healthy 2024-02-10T09:03:04.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:03.924798+0000 mon.a (mon.0) 200 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/609 objects degraded (6.240%), 13 pgs degraded) 2024-02-10T09:03:04.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:03.924877+0000 mon.a (mon.0) 201 : cluster [INF] Cluster is now healthy 2024-02-10T09:03:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:03.402722+0000 mgr.y (mgr.25069) 115 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:05.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:03.402722+0000 mgr.y (mgr.25069) 115 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:05.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:03.402722+0000 mgr.y (mgr.25069) 115 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:05.403164+0000 mgr.y (mgr.25069) 116 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:06.586445+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:05.403164+0000 mgr.y (mgr.25069) 116 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:07.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:06.586445+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:07.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:05.403164+0000 mgr.y (mgr.25069) 116 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:07.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:06.586445+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:09.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:07.403826+0000 mgr.y (mgr.25069) 117 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:07.403826+0000 mgr.y (mgr.25069) 117 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:09.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:07.403826+0000 mgr.y (mgr.25069) 117 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:09.404297+0000 mgr.y (mgr.25069) 118 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:10.882648+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:03:11.343 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:09.404297+0000 mgr.y (mgr.25069) 118 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:11.343 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:10.882648+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:03:11.343 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:09.404297+0000 mgr.y (mgr.25069) 118 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:11.343 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:10.882648+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:03:12.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:10.882972+0000 mgr.y (mgr.25069) 119 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:03:12.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:03:10.884358+0000 mgr.y (mgr.25069) 120 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-10T09:03:12.312 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:10.882972+0000 mgr.y (mgr.25069) 119 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:03:12.312 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:03:10.884358+0000 mgr.y (mgr.25069) 120 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-10T09:03:12.312 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:10.882972+0000 mgr.y (mgr.25069) 119 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-10T09:03:12.312 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:03:10.884358+0000 mgr.y (mgr.25069) 120 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-10T09:03:13.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:11.404876+0000 mgr.y (mgr.25069) 121 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:12.338095+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:12.341372+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:12.342110+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:12.343980+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:11.404876+0000 mgr.y (mgr.25069) 121 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:12.338095+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:12.341372+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:12.342110+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:03:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:12.343980+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-10T09:03:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:11.404876+0000 mgr.y (mgr.25069) 121 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:12.338095+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:12.341372+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-10T09:03:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:12.342110+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:03:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:12.343980+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-10T09:03:14.280 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:03:12.333412+0000 mgr.y (mgr.25069) 122 : cephadm [INF] Upgrade: Updating osd.1 2024-02-10T09:03:14.280 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:03:12.343414+0000 mgr.y (mgr.25069) 123 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-10T09:03:14.280 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:03:12.333412+0000 mgr.y (mgr.25069) 122 : cephadm [INF] Upgrade: Updating osd.1 2024-02-10T09:03:14.280 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:03:12.343414+0000 mgr.y (mgr.25069) 123 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-10T09:03:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:03:12.333412+0000 mgr.y (mgr.25069) 122 : cephadm [INF] Upgrade: Updating osd.1 2024-02-10T09:03:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:03:12.343414+0000 mgr.y (mgr.25069) 123 : cephadm [INF] Deploying daemon osd.1 on smithi040 2024-02-10T09:03:15.124 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:15 smithi040 systemd[1]: Stopping Ceph osd.1 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:03:15.124 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:13.405469+0000 mgr.y (mgr.25069) 124 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:15.125 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:13.405469+0000 mgr.y (mgr.25069) 124 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:15.127 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:03:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:13.405469+0000 mgr.y (mgr.25069) 124 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:15.425 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:15 smithi040 bash[42783]: debug 2024-02-10T09:03:15.122+0000 7f7c3d754700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:03:15.425 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:15 smithi040 bash[42783]: debug 2024-02-10T09:03:15.122+0000 7f7c3d754700 -1 osd.1 71 *** Got signal Terminated *** 2024-02-10T09:03:15.425 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:15 smithi040 bash[42783]: debug 2024-02-10T09:03:15.122+0000 7f7c3d754700 -1 osd.1 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:03:15.791 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:15 smithi040 bash[79981]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.1 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (3m) 20s ago 26m 14.5M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (3m) 89s ago 26m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (4m) 89s ago 30m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (13m) 20s ago 32m 420M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (113s) 20s ago 32m 55.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (2m) 89s ago 30m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (84s) 20s ago 30m 47.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (4m) 20s ago 27m 14.8M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:03:15.792 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (3m) 89s ago 27m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (24s) 20s ago 30m 12.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (29m) 20s ago 29m 47.2M 4096M 15.2.0 204a01f9b0b6 001988d9b38e 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (29m) 20s ago 29m 46.5M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (28m) 20s ago 28m 51.4M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (28m) 89s ago 28m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (28m) 89s ago 28m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (28m) 89s ago 28m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (27m) 89s ago 27m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (3m) 89s ago 27m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (25m) 20s ago 25m 40.3M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:03:15.793 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (25m) 89s ago 25m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:03:16.257 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:03:16.258 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:03:16.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.114225+0000 mgr.y (mgr.25069) 125 : audit [DBG] from='client.54231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:16.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.378417+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.378440+0000 mon.a (mon.0) 205 : cluster [INF] osd.1 failed (root=default,host=smithi040) (connection refused reported by osd.2) 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.378565+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.378695+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.378798+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.378934+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379028+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379138+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379210+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379277+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379368+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379476+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379578+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379680+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.379776+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.779412+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.779511+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.779525+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.779703+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.779821+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.779879+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780112+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780184+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.780192+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780290+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780331+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780511+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.780593+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780685+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780787+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.780872+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.780997+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.781073+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.781379+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.782027+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.783825+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.784253+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.784636+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.785286+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.785943+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.114225+0000 mgr.y (mgr.25069) 125 : audit [DBG] from='client.54231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:16.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.378417+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.378440+0000 mon.a (mon.0) 205 : cluster [INF] osd.1 failed (root=default,host=smithi040) (connection refused reported by osd.2) 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.378565+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.378695+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.378798+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.378934+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379028+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379138+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379210+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379277+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379368+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379476+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379578+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379680+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.379776+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.779412+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.779511+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.779525+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.114225+0000 mgr.y (mgr.25069) 125 : audit [DBG] from='client.54231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.378417+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.378440+0000 mon.a (mon.0) 205 : cluster [INF] osd.1 failed (root=default,host=smithi040) (connection refused reported by osd.2) 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.378565+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.378695+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.378798+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.378934+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379028+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379138+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379210+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379277+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379368+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379476+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379578+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379680+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.379776+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.779412+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.779511+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-10T09:03:16.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.779525+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.779703+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.779821+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.779879+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780112+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780184+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.780192+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780290+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780331+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780511+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.780593+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780685+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780787+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.780872+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.780997+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.781073+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.781379+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.782027+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.783825+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.779703+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.779821+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.779879+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780112+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780184+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.780192+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780290+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780331+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780511+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.780593+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780685+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780787+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.780872+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.780997+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.781073+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.781379+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.782027+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.783825+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.784253+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.784636+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.785286+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.785943+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.784253+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.784636+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.785286+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.785943+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:16.601 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:03:16.601 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:03:16.601 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:03:16.601 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (1 remaining).", 2024-02-10T09:03:16.602 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:03:16.602 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "1/8 daemons upgraded", 2024-02-10T09:03:16.602 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:03:16.602 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:03:16.602 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:03:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:15.405775+0000 mgr.y (mgr.25069) 126 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.454822+0000 mgr.y (mgr.25069) 127 : audit [DBG] from='client.54237 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:15.777401+0000 mgr.y (mgr.25069) 128 : audit [DBG] from='client.54243 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:16.006304+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:03:17.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:16.017686+0000 mon.a (mon.0) 234 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2024-02-10T09:03:17.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:16.257214+0000 mon.c (mon.1) 6 : audit [DBG] from='client.64192 172.21.15.40:0/4158966928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:17.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:15.405775+0000 mgr.y (mgr.25069) 126 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:17.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.454822+0000 mgr.y (mgr.25069) 127 : audit [DBG] from='client.54237 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:17.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:15.777401+0000 mgr.y (mgr.25069) 128 : audit [DBG] from='client.54243 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:17.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:16.006304+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:03:17.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:16.017686+0000 mon.a (mon.0) 234 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2024-02-10T09:03:17.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:16.257214+0000 mon.c (mon.1) 6 : audit [DBG] from='client.64192 172.21.15.40:0/4158966928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:17.340 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:15.405775+0000 mgr.y (mgr.25069) 126 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:17.340 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.454822+0000 mgr.y (mgr.25069) 127 : audit [DBG] from='client.54237 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:17.340 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:15.777401+0000 mgr.y (mgr.25069) 128 : audit [DBG] from='client.54243 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:17.340 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:16.006304+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:03:17.340 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:16.017686+0000 mon.a (mon.0) 234 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2024-02-10T09:03:17.340 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:16.257214+0000 mon.c (mon.1) 6 : audit [DBG] from='client.64192 172.21.15.40:0/4158966928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:17.925 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:17 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.1.service: Succeeded. 2024-02-10T09:03:17.925 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:17 smithi040 systemd[1]: Stopped Ceph osd.1 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:03:17.926 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:17 smithi040 systemd[1]: Starting Ceph osd.1 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:03:18.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:16.601105+0000 mgr.y (mgr.25069) 129 : audit [DBG] from='client.64198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:18.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:17.020641+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2024-02-10T09:03:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:16.601105+0000 mgr.y (mgr.25069) 129 : audit [DBG] from='client.64198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:17.020641+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2024-02-10T09:03:18.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:16.601105+0000 mgr.y (mgr.25069) 129 : audit [DBG] from='client.64198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:18.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:17.020641+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2024-02-10T09:03:18.920 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-10T09:03:18.921 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:18 smithi040 bash[80385]: --> ceph-volume lvm activate successful for osd ID: 1 2024-02-10T09:03:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:17.406346+0000 mgr.y (mgr.25069) 130 : cluster [DBG] pgmap v58: 129 pgs: 51 peering, 1 stale+active+clean, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:18.018237+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-02-10T09:03:19.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:17.406346+0000 mgr.y (mgr.25069) 130 : cluster [DBG] pgmap v58: 129 pgs: 51 peering, 1 stale+active+clean, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:19.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:18.018237+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-02-10T09:03:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:17.406346+0000 mgr.y (mgr.25069) 130 : cluster [DBG] pgmap v58: 129 pgs: 51 peering, 1 stale+active+clean, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:18.018237+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 8 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-02-10T09:03:20.175 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:03:19.748+0000 7ff60bd1e700 1 -- 172.21.15.40:0/4084165957 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a5c4a92680 con 0x55a5c4a59000 2024-02-10T09:03:20.175 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:19 smithi040 bash[80658]: 4893de65913ad6bc841998bd6c0c4a552dc156ab20f849396813e350b08b9c8a 2024-02-10T09:03:20.175 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:19 smithi040 systemd[1]: Started Ceph osd.1 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:03:20.676 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:03:20.265+0000 7ff6137ac380 -1 Falling back to public interface 2024-02-10T09:03:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:19.406903+0000 mgr.y (mgr.25069) 131 : cluster [DBG] pgmap v59: 129 pgs: 51 peering, 1 stale+active+clean, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:19.882830+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:21.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:19.890009+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:21.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:19.891757+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:03:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:19.406903+0000 mgr.y (mgr.25069) 131 : cluster [DBG] pgmap v59: 129 pgs: 51 peering, 1 stale+active+clean, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:19.882830+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:19.890009+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:19.891757+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:03:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:19.406903+0000 mgr.y (mgr.25069) 131 : cluster [DBG] pgmap v59: 129 pgs: 51 peering, 1 stale+active+clean, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-10T09:03:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:19.882830+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:19.890009+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:19.891757+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:03:22.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:21.884336+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: Degraded data redundancy: 6/609 objects degraded (0.985%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:03:22.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:21.884336+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: Degraded data redundancy: 6/609 objects degraded (0.985%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:03:22.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:21 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:21.884336+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: Degraded data redundancy: 6/609 objects degraded (0.985%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:03:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:21.407409+0000 mgr.y (mgr.25069) 132 : cluster [DBG] pgmap v60: 129 pgs: 1 active+undersized+degraded, 51 peering, 4 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 6/609 objects degraded (0.985%) 2024-02-10T09:03:23.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:21.407409+0000 mgr.y (mgr.25069) 132 : cluster [DBG] pgmap v60: 129 pgs: 1 active+undersized+degraded, 51 peering, 4 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 6/609 objects degraded (0.985%) 2024-02-10T09:03:23.426 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:03:23.011+0000 7ff6137ac380 -1 osd.1 71 log_to_monitors {default=true} 2024-02-10T09:03:23.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:21.407409+0000 mgr.y (mgr.25069) 132 : cluster [DBG] pgmap v60: 129 pgs: 1 active+undersized+degraded, 51 peering, 4 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 6/609 objects degraded (0.985%) 2024-02-10T09:03:24.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.015777+0000 mon.a (mon.0) 240 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.685029+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.690508+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.697777+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.700735+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.702416+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.703803+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.705205+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.706547+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.708485+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.708789+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.711754+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.715037+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.715372+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.718043+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.721788+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:03:24.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.722157+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.724990+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.728349+0000 mon.b (mon.2) 190 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.728689+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.729420+0000 mon.b (mon.2) 191 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.729706+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.730336+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.730632+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.731255+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.731561+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.732195+0000 mon.b (mon.2) 194 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.732473+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.733071+0000 mon.b (mon.2) 195 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.733366+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:03:24.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.733967+0000 mon.b (mon.2) 196 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.734254+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.734888+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.735172+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.735759+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.736071+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.736695+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.736974+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.737562+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.737861+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.738475+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.738770+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.741541+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.745430+0000 mon.b (mon.2) 202 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.745768+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.747802+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.754257+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.764230+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.425 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:03:23.974+0000 7ff60248e700 -1 osd.1 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.015777+0000 mon.a (mon.0) 240 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.685029+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.690508+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.697777+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.700735+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.702416+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.703803+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.705205+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.706547+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.708485+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.708789+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.711754+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.715037+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.715372+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.718043+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.015777+0000 mon.a (mon.0) 240 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.685029+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.690508+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.697777+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:03:24.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.700735+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.702416+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.703803+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.705205+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.706547+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.708485+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.708789+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.711754+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.715037+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.715372+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.718043+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.721788+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.722157+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.724990+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.728349+0000 mon.b (mon.2) 190 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.728689+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.729420+0000 mon.b (mon.2) 191 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.729706+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.730336+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.730632+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.731255+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.731561+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.732195+0000 mon.b (mon.2) 194 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.732473+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.733071+0000 mon.b (mon.2) 195 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.733366+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.721788+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.722157+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.724990+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.728349+0000 mon.b (mon.2) 190 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.728689+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.729420+0000 mon.b (mon.2) 191 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.729706+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.730336+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:03:24.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.730632+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.731255+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.731561+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.732195+0000 mon.b (mon.2) 194 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.732473+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.733071+0000 mon.b (mon.2) 195 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.733366+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.733967+0000 mon.b (mon.2) 196 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.734254+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:03:24.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.734888+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.735172+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.735759+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.736071+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.736695+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.736974+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.737562+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.737861+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.738475+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.738770+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.741541+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.745430+0000 mon.b (mon.2) 202 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.745768+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:03:24.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.747802+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.754257+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.764230+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.733967+0000 mon.b (mon.2) 196 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.734254+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.734888+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.735172+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.735759+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.736071+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.736695+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.736974+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.737562+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.737861+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.738475+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.738770+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.741541+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.745430+0000 mon.b (mon.2) 202 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.745768+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.747802+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.754257+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:24.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.764230+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:23.408242+0000 mgr.y (mgr.25069) 133 : cluster [DBG] pgmap v61: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:03:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:03:23.707276+0000 mgr.y (mgr.25069) 134 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:03:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:03:23.745052+0000 mgr.y (mgr.25069) 135 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:03:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:23.938056+0000 mon.a (mon.0) 266 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs inactive, 13 pgs peering) 2024-02-10T09:03:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.952665+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T09:03:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:23.952722+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2024-02-10T09:03:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:23.953676+0000 mon.a (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:24 smithi145 bash[39917]: debug 2024-02-10T09:03:24.958+0000 7fafe1c28700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:24 smithi145 bash[39917]: debug 2024-02-10T09:03:24.959+0000 7fafdfc24700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:24 smithi145 bash[39917]: debug 2024-02-10T09:03:24.960+0000 7fafdfc24700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:24 smithi145 bash[39917]: debug 2024-02-10T09:03:24.960+0000 7fafe0c26700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:24 smithi145 bash[39917]: debug 2024-02-10T09:03:24.963+0000 7fafe342b700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:25 smithi145 bash[39917]: debug 2024-02-10T09:03:25.058+0000 7fafe0425700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:25 smithi145 bash[39917]: debug 2024-02-10T09:03:25.058+0000 7fafe0c26700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:25.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:23.408242+0000 mgr.y (mgr.25069) 133 : cluster [DBG] pgmap v61: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:03:25.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:03:23.707276+0000 mgr.y (mgr.25069) 134 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:03:23.745052+0000 mgr.y (mgr.25069) 135 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:23.938056+0000 mon.a (mon.0) 266 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs inactive, 13 pgs peering) 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.952665+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:23.952722+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:23.953676+0000 mon.a (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:23.408242+0000 mgr.y (mgr.25069) 133 : cluster [DBG] pgmap v61: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:03:23.707276+0000 mgr.y (mgr.25069) 134 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:03:23.745052+0000 mgr.y (mgr.25069) 135 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:23.938056+0000 mon.a (mon.0) 266 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs inactive, 13 pgs peering) 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.952665+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:23.952722+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2024-02-10T09:03:25.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:23.953676+0000 mon.a (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:03:26.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:24.944418+0000 mon.a (mon.0) 270 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:03:26.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:24.951543+0000 mon.a (mon.0) 271 : cluster [INF] osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963] boot 2024-02-10T09:03:26.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:24.951544+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T09:03:26.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:24.951648+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-10T09:03:26.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:25.951003+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-10T09:03:26.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:24.944418+0000 mon.a (mon.0) 270 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:03:26.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:24.951543+0000 mon.a (mon.0) 271 : cluster [INF] osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963] boot 2024-02-10T09:03:26.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:24.951544+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:24.951648+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:25.951003+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:24.944418+0000 mon.a (mon.0) 270 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:24.951543+0000 mon.a (mon.0) 271 : cluster [INF] osd.1 [v2:172.21.15.40:6810/3848566963,v1:172.21.15.40:6811/3848566963] boot 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:24.951544+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:24.951648+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-10T09:03:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:25.951003+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-10T09:03:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:25.408717+0000 mgr.y (mgr.25069) 136 : cluster [DBG] pgmap v64: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:03:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:26.599732+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:27.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:26 smithi145 bash[39917]: debug 2024-02-10T09:03:26.750+0000 7fafe4c2e700 -1 osd.5 76 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:27.033 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:03:26 smithi145 bash[39917]: debug 2024-02-10T09:03:26.750+0000 7fafe442d700 -1 osd.5 76 build_incremental_map_msg missing incremental map 75 2024-02-10T09:03:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:25.408717+0000 mgr.y (mgr.25069) 136 : cluster [DBG] pgmap v64: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:03:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:26.599732+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:25.408717+0000 mgr.y (mgr.25069) 136 : cluster [DBG] pgmap v64: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:03:27.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:26.599732+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:27.728715+0000 mon.a (mon.0) 275 : cluster [WRN] Health check update: Degraded data redundancy: 82/609 objects degraded (13.465%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T09:03:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:27.728715+0000 mon.a (mon.0) 275 : cluster [WRN] Health check update: Degraded data redundancy: 82/609 objects degraded (13.465%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T09:03:28.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:27.728715+0000 mon.a (mon.0) 275 : cluster [WRN] Health check update: Degraded data redundancy: 82/609 objects degraded (13.465%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T09:03:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:27.409521+0000 mgr.y (mgr.25069) 137 : cluster [DBG] pgmap v66: 129 pgs: 4 peering, 5 active+undersized+degraded, 13 active+undersized, 107 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:03:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:27.409521+0000 mgr.y (mgr.25069) 137 : cluster [DBG] pgmap v66: 129 pgs: 4 peering, 5 active+undersized+degraded, 13 active+undersized, 107 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:03:29.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:27.409521+0000 mgr.y (mgr.25069) 137 : cluster [DBG] pgmap v66: 129 pgs: 4 peering, 5 active+undersized+degraded, 13 active+undersized, 107 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:03:30.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:29.990748+0000 mon.a (mon.0) 276 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/609 objects degraded (4.598%), 5 pgs degraded) 2024-02-10T09:03:30.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:29.990779+0000 mon.a (mon.0) 277 : cluster [INF] Cluster is now healthy 2024-02-10T09:03:30.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:29.990748+0000 mon.a (mon.0) 276 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/609 objects degraded (4.598%), 5 pgs degraded) 2024-02-10T09:03:30.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:29.990779+0000 mon.a (mon.0) 277 : cluster [INF] Cluster is now healthy 2024-02-10T09:03:30.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:29.990748+0000 mon.a (mon.0) 276 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/609 objects degraded (4.598%), 5 pgs degraded) 2024-02-10T09:03:30.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:29.990779+0000 mon.a (mon.0) 277 : cluster [INF] Cluster is now healthy 2024-02-10T09:03:31.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:29.410169+0000 mgr.y (mgr.25069) 138 : cluster [DBG] pgmap v67: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:31.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:29.410169+0000 mgr.y (mgr.25069) 138 : cluster [DBG] pgmap v67: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:31.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:29.410169+0000 mgr.y (mgr.25069) 138 : cluster [DBG] pgmap v67: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:33.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:31.410804+0000 mgr.y (mgr.25069) 139 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:33.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:31.410804+0000 mgr.y (mgr.25069) 139 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:31.410804+0000 mgr.y (mgr.25069) 139 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:35.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:33.411486+0000 mgr.y (mgr.25069) 140 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:35.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:33.411486+0000 mgr.y (mgr.25069) 140 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:33.411486+0000 mgr.y (mgr.25069) 140 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:37.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:35.412100+0000 mgr.y (mgr.25069) 141 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:36.611058+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:35.412100+0000 mgr.y (mgr.25069) 141 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:36.611058+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:35.412100+0000 mgr.y (mgr.25069) 141 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:36.611058+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:03:39.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:37.413030+0000 mgr.y (mgr.25069) 142 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:39.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:37.413030+0000 mgr.y (mgr.25069) 142 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:37.413030+0000 mgr.y (mgr.25069) 142 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:41.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:39.413484+0000 mgr.y (mgr.25069) 143 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:41.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:39.413484+0000 mgr.y (mgr.25069) 143 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:39.413484+0000 mgr.y (mgr.25069) 143 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:42.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.416793+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.417143+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.417298+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.417473+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.417616+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.417826+0000 mon.b (mon.2) 207 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.417941+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:41.418362+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.416793+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.417143+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.417298+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T09:03:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.417473+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.417616+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-10T09:03:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.417826+0000 mon.b (mon.2) 207 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.417941+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:41.418362+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.416793+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T09:03:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.417143+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-10T09:03:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.417298+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-10T09:03:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.417473+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.417616+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-10T09:03:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.417826+0000 mon.b (mon.2) 207 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.417941+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-10T09:03:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:41.418362+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-10T09:03:43.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:41.414012+0000 mgr.y (mgr.25069) 144 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:43.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:41.414012+0000 mgr.y (mgr.25069) 144 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:41.414012+0000 mgr.y (mgr.25069) 144 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:45.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:43.414742+0000 mgr.y (mgr.25069) 145 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:45.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:43.414742+0000 mgr.y (mgr.25069) 145 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:45.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:43.414742+0000 mgr.y (mgr.25069) 145 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:45.415363+0000 mgr.y (mgr.25069) 146 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:45.415363+0000 mgr.y (mgr.25069) 146 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:45.415363+0000 mgr.y (mgr.25069) 146 : cluster [DBG] pgmap v75: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:47.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:03:48.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:46.946805+0000 mgr.y (mgr.25069) 147 : audit [DBG] from='client.54267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:48.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:46.946805+0000 mgr.y (mgr.25069) 147 : audit [DBG] from='client.54267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:48.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:46.946805+0000 mgr.y (mgr.25069) 147 : audit [DBG] from='client.54267 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:49.212 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:47.415988+0000 mgr.y (mgr.25069) 148 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:49.212 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:47.415988+0000 mgr.y (mgr.25069) 148 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:49.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:47.415988+0000 mgr.y (mgr.25069) 148 : cluster [DBG] pgmap v76: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:49.888 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:03:49.888 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (4m) 26s ago 27m 14.5M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:03:49.888 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (3m) 2m ago 27m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (4m) 2m ago 30m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (14m) 26s ago 32m 423M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (2m) 26s ago 32m 57.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (3m) 2m ago 31m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (118s) 26s ago 31m 51.4M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (4m) 26s ago 27m 13.0M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (4m) 2m ago 27m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (58s) 26s ago 30m 38.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (30s) 26s ago 30m 10.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (29m) 26s ago 29m 47.3M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (29m) 26s ago 29m 52.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (29m) 2m ago 29m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (28m) 2m ago 28m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (28m) 2m ago 28m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:03:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (28m) 2m ago 28m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:03:49.890 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (4m) 2m ago 27m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:03:49.890 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (25m) 26s ago 25m 40.5M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:03:49.890 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (25m) 2m ago 25m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:03:50.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.877171+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.877848+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.878248+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.878661+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.878991+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.879307+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.881121+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.881655+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.882230+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.882697+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.883074+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.877171+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.877848+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.878248+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.878661+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.878991+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.879307+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.881121+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.881655+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.882230+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.882697+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.883074+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.877171+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.877848+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.878248+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.878661+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.878991+0000 mon.b (mon.2) 212 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.879307+0000 mon.b (mon.2) 213 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.881121+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:03:50.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.881655+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.882230+0000 mon.b (mon.2) 216 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.882697+0000 mon.b (mon.2) 217 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.883074+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:03:50.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-02-10T09:03:51.219 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:49.416390+0000 mgr.y (mgr.25069) 149 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:51.220 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:49.875157+0000 mgr.y (mgr.25069) 150 : audit [DBG] from='client.54273 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:51.220 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:49.416390+0000 mgr.y (mgr.25069) 149 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:51.220 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:49.875157+0000 mgr.y (mgr.25069) 150 : audit [DBG] from='client.54273 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:49.416390+0000 mgr.y (mgr.25069) 149 : cluster [DBG] pgmap v77: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:51.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:49.875157+0000 mgr.y (mgr.25069) 150 : audit [DBG] from='client.54273 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:52.772 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:03:53.358 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:51.416929+0000 mgr.y (mgr.25069) 151 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:53.358 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:52.760855+0000 mon.a (mon.0) 283 : audit [DBG] from='client.64222 172.21.15.40:0/4261277326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:53.358 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:51.416929+0000 mgr.y (mgr.25069) 151 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:53.358 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:52.760855+0000 mon.a (mon.0) 283 : audit [DBG] from='client.64222 172.21.15.40:0/4261277326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:53.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 7'"'"'' 2024-02-10T09:03:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:51.416929+0000 mgr.y (mgr.25069) 151 : cluster [DBG] pgmap v78: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:52.760855+0000 mon.a (mon.0) 283 : audit [DBG] from='client.64222 172.21.15.40:0/4261277326' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:03:55.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:53.417617+0000 mgr.y (mgr.25069) 152 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:55.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:53.417617+0000 mgr.y (mgr.25069) 152 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:53.417617+0000 mgr.y (mgr.25069) 152 : cluster [DBG] pgmap v79: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:56.840 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:03:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:55.410019+0000 mgr.y (mgr.25069) 153 : audit [DBG] from='client.54285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:55.418001+0000 mgr.y (mgr.25069) 154 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:55.410019+0000 mgr.y (mgr.25069) 153 : audit [DBG] from='client.54285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:55.418001+0000 mgr.y (mgr.25069) 154 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:57.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1' 2024-02-10T09:03:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:55.410019+0000 mgr.y (mgr.25069) 153 : audit [DBG] from='client.54285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:03:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:55.418001+0000 mgr.y (mgr.25069) 154 : cluster [DBG] pgmap v80: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:59.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:03:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:57.418916+0000 mgr.y (mgr.25069) 155 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:03:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:57.418916+0000 mgr.y (mgr.25069) 155 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:03:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:03:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:57.418916+0000 mgr.y (mgr.25069) 155 : cluster [DBG] pgmap v81: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:00.759 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:01.406 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:03:59.419403+0000 mgr.y (mgr.25069) 156 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:01.406 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:03:59.455841+0000 mgr.y (mgr.25069) 157 : audit [DBG] from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:01.406 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:00.758056+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:01.406 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:01.105897+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:01.407 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:03:59.419403+0000 mgr.y (mgr.25069) 156 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:01.407 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:03:59.455841+0000 mgr.y (mgr.25069) 157 : audit [DBG] from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:01.407 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:00.758056+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:01.407 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:01.105897+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:01.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:04:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:03:59.419403+0000 mgr.y (mgr.25069) 156 : cluster [DBG] pgmap v82: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:03:59.455841+0000 mgr.y (mgr.25069) 157 : audit [DBG] from='client.64234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:00.758056+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:01.105897+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:02.256 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:00.753788+0000 mgr.y (mgr.25069) 158 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:02.257 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:01.109817+0000 mgr.y (mgr.25069) 159 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:02.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:00.753788+0000 mgr.y (mgr.25069) 158 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:02.257 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:01.109817+0000 mgr.y (mgr.25069) 159 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:00.753788+0000 mgr.y (mgr.25069) 158 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:01.109817+0000 mgr.y (mgr.25069) 159 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:01.419830+0000 mgr.y (mgr.25069) 160 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:01.419830+0000 mgr.y (mgr.25069) 160 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:03.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:01.419830+0000 mgr.y (mgr.25069) 160 : cluster [DBG] pgmap v83: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:03.714 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:04:04.387 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:04:04.387 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (4m) 40s ago 27m 14.5M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:04:04.387 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (4m) 2m ago 27m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (5m) 2m ago 31m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (14m) 40s ago 32m 423M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (2m) 40s ago 33m 57.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (3m) 2m ago 31m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (2m) 40s ago 31m 51.4M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (4m) 40s ago 28m 13.0M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (4m) 2m ago 28m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (73s) 40s ago 30m 38.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (44s) 40s ago 30m 10.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (30m) 40s ago 30m 47.3M 4096M 15.2.0 204a01f9b0b6 7c5ab0f6a731 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (29m) 40s ago 29m 52.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (29m) 2m ago 29m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (29m) 2m ago 29m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:04:04.388 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (28m) 2m ago 28m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:04:04.389 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (28m) 2m ago 28m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:04:04.389 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (4m) 2m ago 28m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:04:04.389 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (26m) 40s ago 26m 40.5M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:04:04.389 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (26m) 2m ago 26m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:04:04.788 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:04:04.788 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:04:04.788 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:04:04.788 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:04.788 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:04:04.788 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 7 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:04:04.789 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:03.420418+0000 mgr.y (mgr.25069) 161 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.703186+0000 mgr.y (mgr.25069) 162 : audit [DBG] from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.927350+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:03.928588+0000 mgr.y (mgr.25069) 163 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:03.928645+0000 mgr.y (mgr.25069) 164 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.929486+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.936239+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.938267+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:03.939068+0000 mgr.y (mgr.25069) 165 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:04:05.052 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.946051+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.947451+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:03.948147+0000 mgr.y (mgr.25069) 166 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.954984+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.956163+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:03.956857+0000 mgr.y (mgr.25069) 167 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.962665+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.964307+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:03.420418+0000 mgr.y (mgr.25069) 161 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.703186+0000 mgr.y (mgr.25069) 162 : audit [DBG] from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:05.053 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.927350+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:03.928588+0000 mgr.y (mgr.25069) 163 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:03.928645+0000 mgr.y (mgr.25069) 164 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.929486+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.936239+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.938267+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:03.939068+0000 mgr.y (mgr.25069) 165 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.946051+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.947451+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:03.948147+0000 mgr.y (mgr.25069) 166 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.954984+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.956163+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:03.956857+0000 mgr.y (mgr.25069) 167 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:04:05.054 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.962665+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.964307+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:03.964592+0000 mgr.y (mgr.25069) 168 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:03.965569+0000 mgr.y (mgr.25069) 169 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.039719+0000 mgr.y (mgr.25069) 170 : audit [DBG] from='client.64246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.374597+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.375341+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.375887+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.376334+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.377062+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.377490+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.055 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.379593+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.380345+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.381118+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.381844+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.382249+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.788118+0000 mon.a (mon.0) 291 : audit [DBG] from='client.54315 172.21.15.40:0/4052953965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:03.964592+0000 mgr.y (mgr.25069) 168 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:03.965569+0000 mgr.y (mgr.25069) 169 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.039719+0000 mgr.y (mgr.25069) 170 : audit [DBG] from='client.64246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.374597+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.375341+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.375887+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.376334+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.377062+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.377490+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.379593+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.380345+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.381118+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.381844+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.382249+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.057 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.788118+0000 mon.a (mon.0) 291 : audit [DBG] from='client.54315 172.21.15.40:0/4052953965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) crash,osd. Upgrade limited to 1 daemons (1 remaining).", 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "2/8 daemons upgraded", 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:04:05.127 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:04:05.128 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:04:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:03.420418+0000 mgr.y (mgr.25069) 161 : cluster [DBG] pgmap v84: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.703186+0000 mgr.y (mgr.25069) 162 : audit [DBG] from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.927350+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:03.928588+0000 mgr.y (mgr.25069) 163 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:03.928645+0000 mgr.y (mgr.25069) 164 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.929486+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.936239+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.938267+0000 mon.b (mon.2) 220 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:03.939068+0000 mgr.y (mgr.25069) 165 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.946051+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.947451+0000 mon.b (mon.2) 221 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:03.948147+0000 mgr.y (mgr.25069) 166 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.954984+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.956163+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:03.956857+0000 mgr.y (mgr.25069) 167 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.962665+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.964307+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:03.964592+0000 mgr.y (mgr.25069) 168 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:03.965569+0000 mgr.y (mgr.25069) 169 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.039719+0000 mgr.y (mgr.25069) 170 : audit [DBG] from='client.64246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.374597+0000 mon.b (mon.2) 224 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.375341+0000 mon.b (mon.2) 225 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.375887+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.376334+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.377062+0000 mon.b (mon.2) 228 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.377490+0000 mon.b (mon.2) 229 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.379593+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.380345+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.381118+0000 mon.b (mon.2) 232 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.381844+0000 mon.b (mon.2) 233 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.382249+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.788118+0000 mon.a (mon.0) 291 : audit [DBG] from='client.54315 172.21.15.40:0/4052953965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:06.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:04.372564+0000 mgr.y (mgr.25069) 171 : audit [DBG] from='client.64252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:05.126978+0000 mgr.y (mgr.25069) 172 : audit [DBG] from='client.54321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:05.373256+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:05.374938+0000 mon.b (mon.2) 235 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:05.375531+0000 mon.b (mon.2) 236 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:05.377138+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:04.372564+0000 mgr.y (mgr.25069) 171 : audit [DBG] from='client.64252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:05.126978+0000 mgr.y (mgr.25069) 172 : audit [DBG] from='client.54321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:05.373256+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:05.374938+0000 mon.b (mon.2) 235 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T09:04:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:05.375531+0000 mon.b (mon.2) 236 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:04:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:05.377138+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-10T09:04:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:04.372564+0000 mgr.y (mgr.25069) 171 : audit [DBG] from='client.64252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:05.126978+0000 mgr.y (mgr.25069) 172 : audit [DBG] from='client.54321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:05.373256+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:05.374938+0000 mon.b (mon.2) 235 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-10T09:04:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:05.375531+0000 mon.b (mon.2) 236 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:04:06.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:05.377138+0000 mon.b (mon.2) 237 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-10T09:04:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:05.366641+0000 mgr.y (mgr.25069) 173 : cephadm [INF] Upgrade: Updating osd.2 2024-02-10T09:04:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:05.376701+0000 mgr.y (mgr.25069) 174 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-10T09:04:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:05.420802+0000 mgr.y (mgr.25069) 175 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:05.366641+0000 mgr.y (mgr.25069) 173 : cephadm [INF] Upgrade: Updating osd.2 2024-02-10T09:04:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:05.376701+0000 mgr.y (mgr.25069) 174 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-10T09:04:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:05.420802+0000 mgr.y (mgr.25069) 175 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:05.366641+0000 mgr.y (mgr.25069) 173 : cephadm [INF] Upgrade: Updating osd.2 2024-02-10T09:04:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:05.376701+0000 mgr.y (mgr.25069) 174 : cephadm [INF] Deploying daemon osd.2 on smithi040 2024-02-10T09:04:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:05.420802+0000 mgr.y (mgr.25069) 175 : cluster [DBG] pgmap v85: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:08.230 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:08 smithi040 systemd[1]: Stopping Ceph osd.2 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:04:08.527 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:08 smithi040 bash[44604]: debug 2024-02-10T09:04:08.228+0000 7f4599c13700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:04:08.527 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:08 smithi040 bash[44604]: debug 2024-02-10T09:04:08.228+0000 7f4599c13700 -1 osd.2 76 *** Got signal Terminated *** 2024-02-10T09:04:08.527 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:08 smithi040 bash[44604]: debug 2024-02-10T09:04:08.228+0000 7f4599c13700 -1 osd.2 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:04:08.925 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:08 smithi040 bash[82988]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.2 2024-02-10T09:04:09.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:07.421346+0000 mgr.y (mgr.25069) 176 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:09.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.334005+0000 mon.a (mon.0) 293 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.334030+0000 mon.a (mon.0) 294 : cluster [INF] osd.2 failed (root=default,host=smithi040) (connection refused reported by osd.6) 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.334297+0000 mon.a (mon.0) 295 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.334484+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.472538+0000 mon.a (mon.0) 297 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.472799+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.472854+0000 mon.a (mon.0) 299 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.472954+0000 mon.a (mon.0) 300 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473028+0000 mon.a (mon.0) 301 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473218+0000 mon.a (mon.0) 302 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473268+0000 mon.a (mon.0) 303 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473364+0000 mon.a (mon.0) 304 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473405+0000 mon.a (mon.0) 305 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473534+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473666+0000 mon.a (mon.0) 307 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473735+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473860+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.473924+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.534823+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.534979+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.535050+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873136+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873404+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873568+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873725+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873768+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873881+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.873923+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874055+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874152+0000 mon.a (mon.0) 322 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874288+0000 mon.a (mon.0) 323 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874360+0000 mon.a (mon.0) 324 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874508+0000 mon.a (mon.0) 325 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874582+0000 mon.a (mon.0) 326 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.874713+0000 mon.a (mon.0) 327 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:07.421346+0000 mgr.y (mgr.25069) 176 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.334005+0000 mon.a (mon.0) 293 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.334030+0000 mon.a (mon.0) 294 : cluster [INF] osd.2 failed (root=default,host=smithi040) (connection refused reported by osd.6) 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.334297+0000 mon.a (mon.0) 295 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.334484+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.472538+0000 mon.a (mon.0) 297 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.472799+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.472854+0000 mon.a (mon.0) 299 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.472954+0000 mon.a (mon.0) 300 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473028+0000 mon.a (mon.0) 301 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473218+0000 mon.a (mon.0) 302 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473268+0000 mon.a (mon.0) 303 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473364+0000 mon.a (mon.0) 304 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473405+0000 mon.a (mon.0) 305 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473534+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473666+0000 mon.a (mon.0) 307 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473735+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473860+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.473924+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.534823+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.534979+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.535050+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873136+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873404+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873568+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873725+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873768+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873881+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.873923+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874055+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874152+0000 mon.a (mon.0) 322 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874288+0000 mon.a (mon.0) 323 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874360+0000 mon.a (mon.0) 324 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874508+0000 mon.a (mon.0) 325 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874582+0000 mon.a (mon.0) 326 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.874713+0000 mon.a (mon.0) 327 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:07.421346+0000 mgr.y (mgr.25069) 176 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:09.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.334005+0000 mon.a (mon.0) 293 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.334030+0000 mon.a (mon.0) 294 : cluster [INF] osd.2 failed (root=default,host=smithi040) (connection refused reported by osd.6) 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.334297+0000 mon.a (mon.0) 295 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.334484+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.472538+0000 mon.a (mon.0) 297 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.472799+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.472854+0000 mon.a (mon.0) 299 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.472954+0000 mon.a (mon.0) 300 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473028+0000 mon.a (mon.0) 301 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473218+0000 mon.a (mon.0) 302 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473268+0000 mon.a (mon.0) 303 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473364+0000 mon.a (mon.0) 304 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.432 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473405+0000 mon.a (mon.0) 305 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473534+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473666+0000 mon.a (mon.0) 307 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473735+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473860+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.473924+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.534823+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.534979+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.535050+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873136+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873404+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873568+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873725+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873768+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873881+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.873923+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874055+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874152+0000 mon.a (mon.0) 322 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874288+0000 mon.a (mon.0) 323 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874360+0000 mon.a (mon.0) 324 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874508+0000 mon.a (mon.0) 325 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874582+0000 mon.a (mon.0) 326 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-10T09:04:09.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.874713+0000 mon.a (mon.0) 327 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-10T09:04:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.933742+0000 mon.a (mon.0) 328 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:04:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:08.938843+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2024-02-10T09:04:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:09.939329+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2024-02-10T09:04:10.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.933742+0000 mon.a (mon.0) 328 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:04:10.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:08.938843+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2024-02-10T09:04:10.419 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:09.939329+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2024-02-10T09:04:10.419 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.933742+0000 mon.a (mon.0) 328 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:04:10.419 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:08.938843+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2024-02-10T09:04:10.419 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:09.939329+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2024-02-10T09:04:10.958 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:10 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.2.service: Succeeded. 2024-02-10T09:04:10.959 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:10 smithi040 systemd[1]: Stopped Ceph osd.2 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:04:10.959 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:10 smithi040 systemd[1]: Starting Ceph osd.2 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:04:10.961 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:09.421841+0000 mgr.y (mgr.25069) 177 : cluster [DBG] pgmap v88: 129 pgs: 6 peering, 8 stale+active+clean, 115 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:10.961 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:09.941831+0000 mon.a (mon.0) 331 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-10T09:04:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:09.421841+0000 mgr.y (mgr.25069) 177 : cluster [DBG] pgmap v88: 129 pgs: 6 peering, 8 stale+active+clean, 115 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:09.941831+0000 mon.a (mon.0) 331 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-10T09:04:11.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:09.421841+0000 mgr.y (mgr.25069) 177 : cluster [DBG] pgmap v88: 129 pgs: 6 peering, 8 stale+active+clean, 115 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:11.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:09.941831+0000 mon.a (mon.0) 331 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-10T09:04:11.925 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:04:11.925 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-10T09:04:11.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-02-10T09:04:11.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-10T09:04:11.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-02-10T09:04:11.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-10T09:04:11.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-10T09:04:11.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:11 smithi040 bash[83285]: --> ceph-volume lvm activate successful for osd ID: 2 2024-02-10T09:04:12.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:11.957993+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: Degraded data redundancy: 5/609 objects degraded (0.821%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:04:12.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:11.957993+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: Degraded data redundancy: 5/609 objects degraded (0.821%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:04:12.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:11.957993+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: Degraded data redundancy: 5/609 objects degraded (0.821%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:04:13.012 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:04:12.760+0000 7fe2dc03f700 1 -- 172.21.15.40:0/1407523010 <== mon.1 v2:172.21.15.40:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c25e18680 con 0x560c25ddf400 2024-02-10T09:04:13.012 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:12 smithi040 bash[83558]: be51c6565b7418b0bc141c6ceaf4870797e6cfad18fb14349454ef2291e18c5b 2024-02-10T09:04:13.012 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:12 smithi040 systemd[1]: Started Ceph osd.2 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:04:13.012 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:11.422288+0000 mgr.y (mgr.25069) 178 : cluster [DBG] pgmap v90: 129 pgs: 1 active+undersized+degraded, 6 peering, 6 stale+active+clean, 4 active+undersized, 112 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 5/609 objects degraded (0.821%) 2024-02-10T09:04:13.013 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:12.885522+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:13.013 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:12.890032+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:13.013 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:12.891308+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:04:13.013 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:11.422288+0000 mgr.y (mgr.25069) 178 : cluster [DBG] pgmap v90: 129 pgs: 1 active+undersized+degraded, 6 peering, 6 stale+active+clean, 4 active+undersized, 112 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 5/609 objects degraded (0.821%) 2024-02-10T09:04:13.013 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:12.885522+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:13.013 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:12.890032+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:13.280 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:12.891308+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:04:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:11.422288+0000 mgr.y (mgr.25069) 178 : cluster [DBG] pgmap v90: 129 pgs: 1 active+undersized+degraded, 6 peering, 6 stale+active+clean, 4 active+undersized, 112 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 5/609 objects degraded (0.821%) 2024-02-10T09:04:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:12.885522+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:12.890032+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:12.891308+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:04:13.676 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:04:13.279+0000 7fe2e3acd380 -1 Falling back to public interface 2024-02-10T09:04:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:13.422866+0000 mgr.y (mgr.25069) 179 : cluster [DBG] pgmap v91: 129 pgs: 9 active+undersized+degraded, 6 peering, 17 active+undersized, 97 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 34/609 objects degraded (5.583%) 2024-02-10T09:04:15.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:13.422866+0000 mgr.y (mgr.25069) 179 : cluster [DBG] pgmap v91: 129 pgs: 9 active+undersized+degraded, 6 peering, 17 active+undersized, 97 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 34/609 objects degraded (5.583%) 2024-02-10T09:04:15.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:13.422866+0000 mgr.y (mgr.25069) 179 : cluster [DBG] pgmap v91: 129 pgs: 9 active+undersized+degraded, 6 peering, 17 active+undersized, 97 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 34/609 objects degraded (5.583%) 2024-02-10T09:04:16.425 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:04:16.029+0000 7fe2e3acd380 -1 osd.2 76 log_to_monitors {default=true} 2024-02-10T09:04:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:16.014093+0000 mon.a (mon.0) 335 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T09:04:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.033411+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T09:04:16.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.033709+0000 mon.a (mon.0) 336 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T09:04:16.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:16.014093+0000 mon.a (mon.0) 335 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T09:04:16.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.033411+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T09:04:16.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.033709+0000 mon.a (mon.0) 336 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T09:04:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:16.014093+0000 mon.a (mon.0) 335 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T09:04:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.033411+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T09:04:16.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.033709+0000 mon.a (mon.0) 336 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-10T09:04:17.425 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:04:17.038+0000 7fe2d4fb4700 -1 osd.2 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:04:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:15.423461+0000 mgr.y (mgr.25069) 180 : cluster [DBG] pgmap v92: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 53/609 objects degraded (8.703%) 2024-02-10T09:04:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.488317+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.495470+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.500750+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.504053+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.505584+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.506901+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.508160+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.509457+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.511955+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.512288+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.517719+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.518718+0000 mon.b (mon.2) 246 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.519054+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.524211+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:15.423461+0000 mgr.y (mgr.25069) 180 : cluster [DBG] pgmap v92: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 53/609 objects degraded (8.703%) 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.488317+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.495470+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.500750+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.504053+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.505584+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.506901+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.508160+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.509457+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.511955+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:04:17.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.512288+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:04:17.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.517719+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:04:17.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.518718+0000 mon.b (mon.2) 246 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.519054+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.429 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.524211+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:04:17.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.525596+0000 mon.b (mon.2) 247 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.525925+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.530794+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.532031+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.532417+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.533113+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.533398+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.534034+0000 mon.b (mon.2) 250 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.534315+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.535040+0000 mon.b (mon.2) 251 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.535418+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.536050+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.536312+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.536958+0000 mon.b (mon.2) 253 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:04:17.431 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.537220+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.525596+0000 mon.b (mon.2) 247 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.525925+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.530794+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.532031+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.532417+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.533113+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.533398+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.534034+0000 mon.b (mon.2) 250 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.534315+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:04:17.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.535040+0000 mon.b (mon.2) 251 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.535418+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.536050+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.536312+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.536958+0000 mon.b (mon.2) 253 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.537220+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.537857+0000 mon.b (mon.2) 254 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.538139+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.538779+0000 mon.b (mon.2) 255 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.433 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.539078+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.539749+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.540012+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.540675+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.540962+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.541611+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.541866+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.542489+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.542755+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.547834+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.549225+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.549560+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.553744+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.560390+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.570441+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.434 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:16.631773+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:17.026380+0000 mon.a (mon.0) 363 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:17.026472+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:17.027328+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:17.027661+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.537857+0000 mon.b (mon.2) 254 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.538139+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.538779+0000 mon.b (mon.2) 255 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.539078+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.539749+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.435 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.540012+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.540675+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.540962+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.541611+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.541866+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.542489+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.542755+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.547834+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.549225+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.549560+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.553744+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.560390+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.570441+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:16.631773+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.436 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:17.026380+0000 mon.a (mon.0) 363 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T09:04:17.437 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:17.026472+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2024-02-10T09:04:17.437 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:17.027328+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:04:17.437 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:17.027661+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:15.423461+0000 mgr.y (mgr.25069) 180 : cluster [DBG] pgmap v92: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 588 MiB used, 709 GiB / 715 GiB avail; 53/609 objects degraded (8.703%) 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.488317+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.495470+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.500750+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.504053+0000 mon.b (mon.2) 240 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.505584+0000 mon.b (mon.2) 241 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.506901+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.508160+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.509457+0000 mon.b (mon.2) 244 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.511955+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.512288+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:04:17.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.517719+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.518718+0000 mon.b (mon.2) 246 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.519054+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.524211+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.525596+0000 mon.b (mon.2) 247 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.525925+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.530794+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.532031+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.532417+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.533113+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.533398+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.534034+0000 mon.b (mon.2) 250 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.534315+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.535040+0000 mon.b (mon.2) 251 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:04:17.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.535418+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.536050+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.536312+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.536958+0000 mon.b (mon.2) 253 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.537220+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.537857+0000 mon.b (mon.2) 254 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.538139+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.538779+0000 mon.b (mon.2) 255 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.539078+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.539749+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.540012+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.540675+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.540962+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.541611+0000 mon.b (mon.2) 258 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.541866+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:04:17.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.542489+0000 mon.b (mon.2) 259 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.542755+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.547834+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.549225+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.549560+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.553744+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.560390+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.570441+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:16.631773+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:17.026380+0000 mon.a (mon.0) 363 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:17.026472+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:17.027328+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:04:17.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:17.027661+0000 mon.a (mon.0) 365 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:04:18.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:16.510512+0000 mgr.y (mgr.25069) 181 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:04:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:16.548914+0000 mgr.y (mgr.25069) 182 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:04:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:17.739009+0000 mon.a (mon.0) 366 : cluster [WRN] Health check update: Degraded data redundancy: 53/609 objects degraded (8.703%), 12 pgs degraded (PG_DEGRADED) 2024-02-10T09:04:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:18.018814+0000 mon.a (mon.0) 367 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:04:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:18.025938+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T09:04:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:18.029098+0000 mon.a (mon.0) 368 : cluster [INF] osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759] boot 2024-02-10T09:04:18.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:18.029153+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:16.510512+0000 mgr.y (mgr.25069) 181 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:16.548914+0000 mgr.y (mgr.25069) 182 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:17.739009+0000 mon.a (mon.0) 366 : cluster [WRN] Health check update: Degraded data redundancy: 53/609 objects degraded (8.703%), 12 pgs degraded (PG_DEGRADED) 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:18.018814+0000 mon.a (mon.0) 367 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:18.025938+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:18.029098+0000 mon.a (mon.0) 368 : cluster [INF] osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759] boot 2024-02-10T09:04:18.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:18.029153+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-10T09:04:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:16.510512+0000 mgr.y (mgr.25069) 181 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:04:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:16.548914+0000 mgr.y (mgr.25069) 182 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:04:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:17.739009+0000 mon.a (mon.0) 366 : cluster [WRN] Health check update: Degraded data redundancy: 53/609 objects degraded (8.703%), 12 pgs degraded (PG_DEGRADED) 2024-02-10T09:04:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:18.018814+0000 mon.a (mon.0) 367 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:04:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:18.025938+0000 mon.b (mon.2) 261 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-10T09:04:18.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:18.029098+0000 mon.a (mon.0) 368 : cluster [INF] osd.2 [v2:172.21.15.40:6818/1958332759,v1:172.21.15.40:6819/1958332759] boot 2024-02-10T09:04:18.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:18.029153+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-10T09:04:19.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:17.423917+0000 mgr.y (mgr.25069) 183 : cluster [DBG] pgmap v94: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 53/609 objects degraded (8.703%) 2024-02-10T09:04:19.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:19.024722+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-10T09:04:19.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:17.423917+0000 mgr.y (mgr.25069) 183 : cluster [DBG] pgmap v94: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 53/609 objects degraded (8.703%) 2024-02-10T09:04:19.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:19.024722+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-10T09:04:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:17.423917+0000 mgr.y (mgr.25069) 183 : cluster [DBG] pgmap v94: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 53/609 objects degraded (8.703%) 2024-02-10T09:04:19.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:19.024722+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-10T09:04:21.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:19.424522+0000 mgr.y (mgr.25069) 184 : cluster [DBG] pgmap v97: 129 pgs: 4 peering, 10 active+undersized+degraded, 18 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 35/609 objects degraded (5.747%) 2024-02-10T09:04:21.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:19.424522+0000 mgr.y (mgr.25069) 184 : cluster [DBG] pgmap v97: 129 pgs: 4 peering, 10 active+undersized+degraded, 18 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 35/609 objects degraded (5.747%) 2024-02-10T09:04:21.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:21 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:19.424522+0000 mgr.y (mgr.25069) 184 : cluster [DBG] pgmap v97: 129 pgs: 4 peering, 10 active+undersized+degraded, 18 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 35/609 objects degraded (5.747%) 2024-02-10T09:04:22.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:21.424992+0000 mgr.y (mgr.25069) 185 : cluster [DBG] pgmap v98: 129 pgs: 4 peering, 9 active+undersized+degraded, 16 active+undersized, 100 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 30/609 objects degraded (4.926%) 2024-02-10T09:04:22.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:21.640787+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:22.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:21.424992+0000 mgr.y (mgr.25069) 185 : cluster [DBG] pgmap v98: 129 pgs: 4 peering, 9 active+undersized+degraded, 16 active+undersized, 100 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 30/609 objects degraded (4.926%) 2024-02-10T09:04:22.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:21.640787+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:21.424992+0000 mgr.y (mgr.25069) 185 : cluster [DBG] pgmap v98: 129 pgs: 4 peering, 9 active+undersized+degraded, 16 active+undersized, 100 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 30/609 objects degraded (4.926%) 2024-02-10T09:04:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:21.640787+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:23.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:22.739998+0000 mon.a (mon.0) 372 : cluster [WRN] Health check update: Degraded data redundancy: 30/609 objects degraded (4.926%), 9 pgs degraded (PG_DEGRADED) 2024-02-10T09:04:23.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:22.739998+0000 mon.a (mon.0) 372 : cluster [WRN] Health check update: Degraded data redundancy: 30/609 objects degraded (4.926%), 9 pgs degraded (PG_DEGRADED) 2024-02-10T09:04:24.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:22.739998+0000 mon.a (mon.0) 372 : cluster [WRN] Health check update: Degraded data redundancy: 30/609 objects degraded (4.926%), 9 pgs degraded (PG_DEGRADED) 2024-02-10T09:04:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:23.425755+0000 mgr.y (mgr.25069) 186 : cluster [DBG] pgmap v99: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:23.741946+0000 mon.a (mon.0) 373 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/609 objects degraded (4.926%), 9 pgs degraded) 2024-02-10T09:04:24.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:23.742003+0000 mon.a (mon.0) 374 : cluster [INF] Cluster is now healthy 2024-02-10T09:04:24.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:23.425755+0000 mgr.y (mgr.25069) 186 : cluster [DBG] pgmap v99: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:23.741946+0000 mon.a (mon.0) 373 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/609 objects degraded (4.926%), 9 pgs degraded) 2024-02-10T09:04:24.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:23.742003+0000 mon.a (mon.0) 374 : cluster [INF] Cluster is now healthy 2024-02-10T09:04:25.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:23.425755+0000 mgr.y (mgr.25069) 186 : cluster [DBG] pgmap v99: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:25.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:23.741946+0000 mon.a (mon.0) 373 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/609 objects degraded (4.926%), 9 pgs degraded) 2024-02-10T09:04:25.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:23.742003+0000 mon.a (mon.0) 374 : cluster [INF] Cluster is now healthy 2024-02-10T09:04:26.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:25.426257+0000 mgr.y (mgr.25069) 187 : cluster [DBG] pgmap v100: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:26.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:25.426257+0000 mgr.y (mgr.25069) 187 : cluster [DBG] pgmap v100: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:27.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:25.426257+0000 mgr.y (mgr.25069) 187 : cluster [DBG] pgmap v100: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:29.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:27.426996+0000 mgr.y (mgr.25069) 188 : cluster [DBG] pgmap v101: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:29.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:27.426996+0000 mgr.y (mgr.25069) 188 : cluster [DBG] pgmap v101: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:29.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:27.426996+0000 mgr.y (mgr.25069) 188 : cluster [DBG] pgmap v101: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:31.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:29.427661+0000 mgr.y (mgr.25069) 189 : cluster [DBG] pgmap v102: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:29.427661+0000 mgr.y (mgr.25069) 189 : cluster [DBG] pgmap v102: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:29.427661+0000 mgr.y (mgr.25069) 189 : cluster [DBG] pgmap v102: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:33.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:31.428256+0000 mgr.y (mgr.25069) 190 : cluster [DBG] pgmap v103: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:33.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:31.428256+0000 mgr.y (mgr.25069) 190 : cluster [DBG] pgmap v103: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:33.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:31.428256+0000 mgr.y (mgr.25069) 190 : cluster [DBG] pgmap v103: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:35.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:33.428923+0000 mgr.y (mgr.25069) 191 : cluster [DBG] pgmap v104: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:35.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:33.428923+0000 mgr.y (mgr.25069) 191 : cluster [DBG] pgmap v104: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:35.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:33.428923+0000 mgr.y (mgr.25069) 191 : cluster [DBG] pgmap v104: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:36.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:04:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:35.429323+0000 mgr.y (mgr.25069) 192 : cluster [DBG] pgmap v105: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:37.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:35.470031+0000 mgr.y (mgr.25069) 193 : audit [DBG] from='client.54333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:37.066 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:35.429323+0000 mgr.y (mgr.25069) 192 : cluster [DBG] pgmap v105: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:37.066 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:35.470031+0000 mgr.y (mgr.25069) 193 : audit [DBG] from='client.54333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:37.066 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:35.429323+0000 mgr.y (mgr.25069) 192 : cluster [DBG] pgmap v105: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:37.067 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:35.470031+0000 mgr.y (mgr.25069) 193 : audit [DBG] from='client.54333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:38.008 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:04:38.008 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (4m) 21s ago 28m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:04:38.008 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (4m) 2m ago 27m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:04:38.008 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (5m) 2m ago 31m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:04:38.008 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (15m) 21s ago 33m 425M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:04:38.008 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (3m) 21s ago 33m 61.5M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (4m) 2m ago 31m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (2m) 21s ago 32m 56.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (5m) 21s ago 28m 13.6M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (5m) 2m ago 28m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (106s) 21s ago 31m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (78s) 21s ago 31m 38.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (25s) 21s ago 30m 13.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (30m) 21s ago 30m 53.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (30m) 2m ago 30m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (29m) 2m ago 29m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (29m) 2m ago 29m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (29m) 2m ago 29m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (5m) 2m ago 28m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:04:38.009 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (26m) 21s ago 26m 40.7M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:04:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (26m) 2m ago 26m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:04:38.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:37.430095+0000 mgr.y (mgr.25069) 194 : cluster [DBG] pgmap v106: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.995085+0000 mgr.y (mgr.25069) 195 : audit [DBG] from='client.54339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.997160+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.997927+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.998333+0000 mon.b (mon.2) 264 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.998724+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.999070+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:37.999422+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:38.001201+0000 mon.b (mon.2) 268 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:38.001684+0000 mon.b (mon.2) 269 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:38.002064+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:38.002409+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:38.002752+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:37.430095+0000 mgr.y (mgr.25069) 194 : cluster [DBG] pgmap v106: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.995085+0000 mgr.y (mgr.25069) 195 : audit [DBG] from='client.54339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.997160+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.997927+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.998333+0000 mon.b (mon.2) 264 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.998724+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.999070+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:37.999422+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:38.001201+0000 mon.b (mon.2) 268 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:38.001684+0000 mon.b (mon.2) 269 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:38.002064+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:38.002409+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:38.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:38.002752+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:37.430095+0000 mgr.y (mgr.25069) 194 : cluster [DBG] pgmap v106: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.995085+0000 mgr.y (mgr.25069) 195 : audit [DBG] from='client.54339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.997160+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.997927+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.998333+0000 mon.b (mon.2) 264 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.998724+0000 mon.b (mon.2) 265 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.999070+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:37.999422+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:38.001201+0000 mon.b (mon.2) 268 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:38.001684+0000 mon.b (mon.2) 269 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:38.002064+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:38.002409+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:39.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:38.002752+0000 mon.b (mon.2) 272 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:40.668 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:04:40.978 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:39.430539+0000 mgr.y (mgr.25069) 196 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:40.979 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:40.656885+0000 mon.c (mon.1) 9 : audit [DBG] from='client.54345 172.21.15.40:0/1591266178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:40.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:39.430539+0000 mgr.y (mgr.25069) 196 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:40.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:40.656885+0000 mon.c (mon.1) 9 : audit [DBG] from='client.54345 172.21.15.40:0/1591266178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:39.430539+0000 mgr.y (mgr.25069) 196 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:41.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:40.656885+0000 mon.c (mon.1) 9 : audit [DBG] from='client.54345 172.21.15.40:0/1591266178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:41.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 8'"'"'' 2024-02-10T09:04:42.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.421299+0000 mon.b (mon.2) 273 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T09:04:42.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.421576+0000 mon.b (mon.2) 274 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.421790+0000 mon.b (mon.2) 275 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2024-02-10T09:04:42.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.421914+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T09:04:42.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.421993+0000 mon.b (mon.2) 276 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.422529+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.422776+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:41.423048+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.421299+0000 mon.b (mon.2) 273 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.421576+0000 mon.b (mon.2) 274 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.421790+0000 mon.b (mon.2) 275 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.421914+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.421993+0000 mon.b (mon.2) 276 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.422529+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.422776+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2024-02-10T09:04:42.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:41.423048+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.421299+0000 mon.b (mon.2) 273 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T09:04:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.421576+0000 mon.b (mon.2) 274 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.421790+0000 mon.b (mon.2) 275 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2024-02-10T09:04:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.421914+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2024-02-10T09:04:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.421993+0000 mon.b (mon.2) 276 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.422529+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.422776+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2024-02-10T09:04:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:41.423048+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2024-02-10T09:04:42.873 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:41.430960+0000 mgr.y (mgr.25069) 197 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:42.874 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:41.430960+0000 mgr.y (mgr.25069) 197 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:41.430960+0000 mgr.y (mgr.25069) 197 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:44.652 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:04:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:43.283325+0000 mgr.y (mgr.25069) 198 : audit [DBG] from='client.64294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:44.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:43.431487+0000 mgr.y (mgr.25069) 199 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:43.283325+0000 mgr.y (mgr.25069) 198 : audit [DBG] from='client.64294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:44.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:43.431487+0000 mgr.y (mgr.25069) 199 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:45.280 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd' 2024-02-10T09:04:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:43.283325+0000 mgr.y (mgr.25069) 198 : audit [DBG] from='client.64294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:43.431487+0000 mgr.y (mgr.25069) 199 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:46.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:45.431896+0000 mgr.y (mgr.25069) 200 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:46.813 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:45.431896+0000 mgr.y (mgr.25069) 200 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:47.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:45.431896+0000 mgr.y (mgr.25069) 200 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:47.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:47.229263+0000 mgr.y (mgr.25069) 201 : audit [DBG] from='client.64300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:47.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:47.229263+0000 mgr.y (mgr.25069) 201 : audit [DBG] from='client.64300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:48.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:47.229263+0000 mgr.y (mgr.25069) 201 : audit [DBG] from='client.64300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:48.542 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:49.127 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:47.432457+0000 mgr.y (mgr.25069) 202 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:49.127 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:48.542105+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:49.127 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:48.560126+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2024-02-10T09:04:49.128 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:47.432457+0000 mgr.y (mgr.25069) 202 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:49.128 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:48.542105+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:49.128 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:48.560126+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2024-02-10T09:04:49.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:04:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:47.432457+0000 mgr.y (mgr.25069) 202 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:48.542105+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:48.560126+0000 mon.b (mon.2) 277 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2024-02-10T09:04:50.121 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:48.537025+0000 mgr.y (mgr.25069) 203 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:50.122 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:48.537025+0000 mgr.y (mgr.25069) 203 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:50.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:48.537025+0000 mgr.y (mgr.25069) 203 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:51.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:49.432921+0000 mgr.y (mgr.25069) 204 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:49.432921+0000 mgr.y (mgr.25069) 204 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:51.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:49.432921+0000 mgr.y (mgr.25069) 204 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:51.972 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (5m) 36s ago 28m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (4m) 3m ago 28m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (5m) 3m ago 31m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (15m) 36s ago 33m 425M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (3m) 36s ago 33m 61.5M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (4m) 3m ago 32m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:04:52.631 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (3m) 36s ago 32m 56.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (5m) 36s ago 28m 13.6M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (5m) 3m ago 28m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (2m) 36s ago 31m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (93s) 36s ago 31m 38.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (40s) 36s ago 30m 13.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (30m) 36s ago 30m 53.7M 4096M 15.2.0 204a01f9b0b6 cbafd2240310 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (30m) 3m ago 30m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (29m) 3m ago 30m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (29m) 3m ago 29m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (29m) 3m ago 29m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (5m) 3m ago 28m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (26m) 36s ago 26m 40.7M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:04:52.632 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (26m) 3m ago 26m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:04:52.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:51.433393+0000 mgr.y (mgr.25069) 205 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:51.957022+0000 mgr.y (mgr.25069) 206 : audit [DBG] from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.620439+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.620948+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.621301+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.621705+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.622047+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.622390+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.624236+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.624671+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.625050+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.625395+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.625768+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:51.433393+0000 mgr.y (mgr.25069) 205 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:51.957022+0000 mgr.y (mgr.25069) 206 : audit [DBG] from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.620439+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.620948+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.621301+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.621705+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.622047+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.622390+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.624236+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.624671+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.625050+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.625395+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:52.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.625768+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.039 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:04:53.039 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:04:53.039 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:04:53.039 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:53.039 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:04:53.039 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 8 2024-02-10T09:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:04:53.041 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:04:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:51.433393+0000 mgr.y (mgr.25069) 205 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:51.957022+0000 mgr.y (mgr.25069) 206 : audit [DBG] from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.620439+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.620948+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.621301+0000 mon.b (mon.2) 280 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.621705+0000 mon.b (mon.2) 281 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.622047+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.622390+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.624236+0000 mon.b (mon.2) 284 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.624671+0000 mon.b (mon.2) 285 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.625050+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.625395+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.625768+0000 mon.b (mon.2) 288 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "", 2024-02-10T09:04:53.372 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:04:53.373 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:04:53.373 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.290672+0000 mgr.y (mgr.25069) 207 : audit [DBG] from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:52.618142+0000 mgr.y (mgr.25069) 208 : audit [DBG] from='client.64318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:53.039330+0000 mon.c (mon.1) 10 : audit [DBG] from='client.64324 172.21.15.40:0/295371874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:53.252932+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:53.485671+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:53.493514+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.290672+0000 mgr.y (mgr.25069) 207 : audit [DBG] from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:52.618142+0000 mgr.y (mgr.25069) 208 : audit [DBG] from='client.64318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:53.039330+0000 mon.c (mon.1) 10 : audit [DBG] from='client.64324 172.21.15.40:0/295371874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:53.252932+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:04:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:53.485671+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:53.493514+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.290672+0000 mgr.y (mgr.25069) 207 : audit [DBG] from='client.64312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:52.618142+0000 mgr.y (mgr.25069) 208 : audit [DBG] from='client.64318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:53.039330+0000 mon.c (mon.1) 10 : audit [DBG] from='client.64324 172.21.15.40:0/295371874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:53.252932+0000 mon.b (mon.2) 289 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:04:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:53.485671+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:53.493514+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:53.371813+0000 mgr.y (mgr.25069) 209 : audit [DBG] from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:53.433954+0000 mgr.y (mgr.25069) 210 : cluster [DBG] pgmap v114: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:54.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:53.497660+0000 mgr.y (mgr.25069) 211 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.806112+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.808290+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.815457+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.817408+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:53.371813+0000 mgr.y (mgr.25069) 209 : audit [DBG] from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:53.433954+0000 mgr.y (mgr.25069) 210 : cluster [DBG] pgmap v114: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:53.497660+0000 mgr.y (mgr.25069) 211 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.806112+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.808290+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.815457+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:54.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.817408+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:53.371813+0000 mgr.y (mgr.25069) 209 : audit [DBG] from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:04:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:53.433954+0000 mgr.y (mgr.25069) 210 : cluster [DBG] pgmap v114: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:53.497660+0000 mgr.y (mgr.25069) 211 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:04:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.806112+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.808290+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:04:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.815457+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.817408+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:55.925 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:54.807337+0000 mgr.y (mgr.25069) 212 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:54.807402+0000 mgr.y (mgr.25069) 213 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:54.818131+0000 mgr.y (mgr.25069) 214 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.824293+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.833896+0000 mon.b (mon.2) 292 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:54.834649+0000 mgr.y (mgr.25069) 215 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.839605+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.840848+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:54.841582+0000 mgr.y (mgr.25069) 216 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.846254+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.847942+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-10T09:04:55.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:54.848141+0000 mgr.y (mgr.25069) 217 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:54.849084+0000 mgr.y (mgr.25069) 218 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:54.807337+0000 mgr.y (mgr.25069) 212 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:54.807402+0000 mgr.y (mgr.25069) 213 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:54.818131+0000 mgr.y (mgr.25069) 214 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.824293+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.833896+0000 mon.b (mon.2) 292 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:54.834649+0000 mgr.y (mgr.25069) 215 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.839605+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.840848+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:54.841582+0000 mgr.y (mgr.25069) 216 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:04:55.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.846254+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.847942+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-10T09:04:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:54.848141+0000 mgr.y (mgr.25069) 217 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-10T09:04:55.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:54.849084+0000 mgr.y (mgr.25069) 218 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:54.807337+0000 mgr.y (mgr.25069) 212 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:54.807402+0000 mgr.y (mgr.25069) 213 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:54.818131+0000 mgr.y (mgr.25069) 214 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.824293+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.833896+0000 mon.b (mon.2) 292 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:54.834649+0000 mgr.y (mgr.25069) 215 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.839605+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:56.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.840848+0000 mon.b (mon.2) 293 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:04:56.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:54.841582+0000 mgr.y (mgr.25069) 216 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:04:56.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.846254+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:56.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.847942+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-10T09:04:56.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:54.848141+0000 mgr.y (mgr.25069) 217 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-10T09:04:56.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:54.849084+0000 mgr.y (mgr.25069) 218 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-10T09:04:57.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:55.434384+0000 mgr.y (mgr.25069) 219 : cluster [DBG] pgmap v115: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:57.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:56.274332+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:56.275507+0000 mon.b (mon.2) 295 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:56.276260+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:04:56.277912+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:55.434384+0000 mgr.y (mgr.25069) 219 : cluster [DBG] pgmap v115: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:56.274332+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:56.275507+0000 mon.b (mon.2) 295 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:56.276260+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:04:57.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:04:56.277912+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-10T09:04:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:55.434384+0000 mgr.y (mgr.25069) 219 : cluster [DBG] pgmap v115: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:56.274332+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:04:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:56.275507+0000 mon.b (mon.2) 295 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-10T09:04:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:56.276260+0000 mon.b (mon.2) 296 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:04:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:04:56.277912+0000 mon.b (mon.2) 297 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-10T09:04:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:56.267440+0000 mgr.y (mgr.25069) 220 : cephadm [INF] Upgrade: Updating osd.3 2024-02-10T09:04:58.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:04:56.277522+0000 mgr.y (mgr.25069) 221 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-10T09:04:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:56.267440+0000 mgr.y (mgr.25069) 220 : cephadm [INF] Upgrade: Updating osd.3 2024-02-10T09:04:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:04:56.277522+0000 mgr.y (mgr.25069) 221 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-10T09:04:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:56.267440+0000 mgr.y (mgr.25069) 220 : cephadm [INF] Upgrade: Updating osd.3 2024-02-10T09:04:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:04:56.277522+0000 mgr.y (mgr.25069) 221 : cephadm [INF] Deploying daemon osd.3 on smithi040 2024-02-10T09:04:59.030 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:04:58 smithi040 systemd[1]: Stopping Ceph osd.3 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:04:59.031 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:57.435211+0000 mgr.y (mgr.25069) 222 : cluster [DBG] pgmap v116: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:59.031 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:57.435211+0000 mgr.y (mgr.25069) 222 : cluster [DBG] pgmap v116: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:57.435211+0000 mgr.y (mgr.25069) 222 : cluster [DBG] pgmap v116: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:04:59.360 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:04:59 smithi040 bash[46018]: debug 2024-02-10T09:04:59.029+0000 7f7c12da4700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:04:59.360 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:04:59 smithi040 bash[46018]: debug 2024-02-10T09:04:59.029+0000 7f7c12da4700 -1 osd.3 81 *** Got signal Terminated *** 2024-02-10T09:04:59.361 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:04:59 smithi040 bash[46018]: debug 2024-02-10T09:04:59.029+0000 7f7c12da4700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:04:59.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:04:59 smithi040 bash[87005]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.3 2024-02-10T09:04:59.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:04:59 smithi040 bash[87066]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.3 2024-02-10T09:05:00.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.275117+0000 mon.a (mon.0) 388 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.275155+0000 mon.a (mon.0) 389 : cluster [INF] osd.3 failed (root=default,host=smithi040) (connection refused reported by osd.4) 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.275252+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.275329+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.275499+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.275938+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.276094+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.276243+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.276426+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.276602+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.276745+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.276878+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.277048+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.277241+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.277391+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.277567+0000 mon.a (mon.0) 403 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.277747+0000 mon.a (mon.0) 404 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.277925+0000 mon.a (mon.0) 405 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.278111+0000 mon.a (mon.0) 406 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.676085+0000 mon.a (mon.0) 407 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.676181+0000 mon.a (mon.0) 408 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.676326+0000 mon.a (mon.0) 409 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.676610+0000 mon.a (mon.0) 410 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.676830+0000 mon.a (mon.0) 411 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.676950+0000 mon.a (mon.0) 412 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677036+0000 mon.a (mon.0) 413 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677153+0000 mon.a (mon.0) 414 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677280+0000 mon.a (mon.0) 415 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677381+0000 mon.a (mon.0) 416 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677450+0000 mon.a (mon.0) 417 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677549+0000 mon.a (mon.0) 418 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677684+0000 mon.a (mon.0) 419 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677764+0000 mon.a (mon.0) 420 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.677864+0000 mon.a (mon.0) 421 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.678001+0000 mon.a (mon.0) 422 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.678118+0000 mon.a (mon.0) 423 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.678257+0000 mon.a (mon.0) 424 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.275117+0000 mon.a (mon.0) 388 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.275155+0000 mon.a (mon.0) 389 : cluster [INF] osd.3 failed (root=default,host=smithi040) (connection refused reported by osd.4) 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.275252+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.275329+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.275499+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.275938+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.276094+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.276243+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.276426+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.276602+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.276745+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.276878+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.277048+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.277241+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.277391+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.277567+0000 mon.a (mon.0) 403 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.277747+0000 mon.a (mon.0) 404 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.277925+0000 mon.a (mon.0) 405 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.278111+0000 mon.a (mon.0) 406 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.676085+0000 mon.a (mon.0) 407 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.676181+0000 mon.a (mon.0) 408 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.676326+0000 mon.a (mon.0) 409 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.676610+0000 mon.a (mon.0) 410 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.676830+0000 mon.a (mon.0) 411 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.676950+0000 mon.a (mon.0) 412 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677036+0000 mon.a (mon.0) 413 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677153+0000 mon.a (mon.0) 414 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677280+0000 mon.a (mon.0) 415 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677381+0000 mon.a (mon.0) 416 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677450+0000 mon.a (mon.0) 417 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677549+0000 mon.a (mon.0) 418 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677684+0000 mon.a (mon.0) 419 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677764+0000 mon.a (mon.0) 420 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.677864+0000 mon.a (mon.0) 421 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.678001+0000 mon.a (mon.0) 422 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.678118+0000 mon.a (mon.0) 423 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:04:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.678257+0000 mon.a (mon.0) 424 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.275117+0000 mon.a (mon.0) 388 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.275155+0000 mon.a (mon.0) 389 : cluster [INF] osd.3 failed (root=default,host=smithi040) (connection refused reported by osd.4) 2024-02-10T09:05:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.275252+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.275329+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.275499+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.275938+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.276094+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.276243+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.276426+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.276602+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.276745+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.276878+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.277048+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.277241+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.277391+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.277567+0000 mon.a (mon.0) 403 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.277747+0000 mon.a (mon.0) 404 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.277925+0000 mon.a (mon.0) 405 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.278111+0000 mon.a (mon.0) 406 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.676085+0000 mon.a (mon.0) 407 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.676181+0000 mon.a (mon.0) 408 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.676326+0000 mon.a (mon.0) 409 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.676610+0000 mon.a (mon.0) 410 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.676830+0000 mon.a (mon.0) 411 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.676950+0000 mon.a (mon.0) 412 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677036+0000 mon.a (mon.0) 413 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677153+0000 mon.a (mon.0) 414 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677280+0000 mon.a (mon.0) 415 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677381+0000 mon.a (mon.0) 416 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677450+0000 mon.a (mon.0) 417 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677549+0000 mon.a (mon.0) 418 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677684+0000 mon.a (mon.0) 419 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-10T09:05:00.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677764+0000 mon.a (mon.0) 420 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-10T09:05:00.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.677864+0000 mon.a (mon.0) 421 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-10T09:05:00.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.678001+0000 mon.a (mon.0) 422 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-10T09:05:00.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.678118+0000 mon.a (mon.0) 423 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:00.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:04:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.678257+0000 mon.a (mon.0) 424 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-10T09:05:01.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.435821+0000 mgr.y (mgr.25069) 223 : cluster [DBG] pgmap v117: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:05:01.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.857862+0000 mon.a (mon.0) 425 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:01.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:04:59.867709+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2024-02-10T09:05:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.435821+0000 mgr.y (mgr.25069) 223 : cluster [DBG] pgmap v117: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:05:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.857862+0000 mon.a (mon.0) 425 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:04:59.867709+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2024-02-10T09:05:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.435821+0000 mgr.y (mgr.25069) 223 : cluster [DBG] pgmap v117: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:05:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.857862+0000 mon.a (mon.0) 425 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:04:59.867709+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2024-02-10T09:05:01.559 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:01 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.3.service: Succeeded. 2024-02-10T09:05:01.560 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:01 smithi040 systemd[1]: Stopped Ceph osd.3 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:05:01.876 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:01 smithi040 systemd[1]: Starting Ceph osd.3 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:05:02.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:00.876571+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2024-02-10T09:05:02.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:00.876571+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2024-02-10T09:05:02.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:00.876571+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2024-02-10T09:05:02.675 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:05:02.675 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-10T09:05:02.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-10T09:05:02.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-02-10T09:05:02.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-10T09:05:02.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-10T09:05:02.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-10T09:05:02.676 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:02 smithi040 bash[87325]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-10T09:05:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:01.436216+0000 mgr.y (mgr.25069) 224 : cluster [DBG] pgmap v120: 129 pgs: 10 peering, 16 stale+active+clean, 103 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:05:03.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:01.871182+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-10T09:05:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:01.436216+0000 mgr.y (mgr.25069) 224 : cluster [DBG] pgmap v120: 129 pgs: 10 peering, 16 stale+active+clean, 103 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:05:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:01.871182+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-10T09:05:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:01.436216+0000 mgr.y (mgr.25069) 224 : cluster [DBG] pgmap v120: 129 pgs: 10 peering, 16 stale+active+clean, 103 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-10T09:05:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:01.871182+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-10T09:05:03.925 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:05:03.486+0000 7f040932e700 1 -- 172.21.15.40:0/3660309057 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dfd1fc2680 con 0x55dfd1f89000 2024-02-10T09:05:03.925 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:03 smithi040 bash[87586]: 1fe1120f381789017d5dbb5d792e101c8acedecb11b58818d97fcb6a362da89d 2024-02-10T09:05:03.925 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:03 smithi040 systemd[1]: Started Ceph osd.3 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:05:04.426 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:05:04.001+0000 7f0410dbc380 -1 Falling back to public interface 2024-02-10T09:05:04.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:03.436920+0000 mgr.y (mgr.25069) 225 : cluster [DBG] pgmap v121: 129 pgs: 13 active+undersized+degraded, 10 peering, 6 stale+active+clean, 14 active+undersized, 86 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 39/609 objects degraded (6.404%) 2024-02-10T09:05:04.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:03.620813+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:04.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:03.623160+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:05:04.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:03.881754+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: Degraded data redundancy: 39/609 objects degraded (6.404%), 13 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:04.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:03.436920+0000 mgr.y (mgr.25069) 225 : cluster [DBG] pgmap v121: 129 pgs: 13 active+undersized+degraded, 10 peering, 6 stale+active+clean, 14 active+undersized, 86 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 39/609 objects degraded (6.404%) 2024-02-10T09:05:04.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:03.620813+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:04.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:03.623160+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:05:04.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:03.881754+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: Degraded data redundancy: 39/609 objects degraded (6.404%), 13 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:03.436920+0000 mgr.y (mgr.25069) 225 : cluster [DBG] pgmap v121: 129 pgs: 13 active+undersized+degraded, 10 peering, 6 stale+active+clean, 14 active+undersized, 86 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 39/609 objects degraded (6.404%) 2024-02-10T09:05:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:03.620813+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:03.623160+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:05:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:03.881754+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: Degraded data redundancy: 39/609 objects degraded (6.404%), 13 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:06.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:05.437518+0000 mgr.y (mgr.25069) 226 : cluster [DBG] pgmap v122: 129 pgs: 18 active+undersized+degraded, 10 peering, 22 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 57/609 objects degraded (9.360%) 2024-02-10T09:05:06.891 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:05:06.757+0000 7f0410dbc380 -1 osd.3 81 log_to_monitors {default=true} 2024-02-10T09:05:06.891 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:05.437518+0000 mgr.y (mgr.25069) 226 : cluster [DBG] pgmap v122: 129 pgs: 18 active+undersized+degraded, 10 peering, 22 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 57/609 objects degraded (9.360%) 2024-02-10T09:05:07.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:05.437518+0000 mgr.y (mgr.25069) 226 : cluster [DBG] pgmap v122: 129 pgs: 18 active+undersized+degraded, 10 peering, 22 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 57/609 objects degraded (9.360%) 2024-02-10T09:05:07.926 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:05:07.669+0000 7f0402aa4700 -1 osd.3 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:05:07.926 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:05:07.614+0000 7f95858b4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:06.761426+0000 mon.c (mon.1) 11 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:06.761779+0000 mon.a (mon.0) 431 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.300919+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.602745+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.607984+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.611413+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.612720+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.613851+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.615212+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:06.761426+0000 mon.c (mon.1) 11 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:06.761779+0000 mon.a (mon.0) 431 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.300919+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:07.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.602745+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.607984+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:05:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.611413+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.612720+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.613851+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:07.928 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.615212+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:08.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:06.761426+0000 mon.c (mon.1) 11 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T09:05:08.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:06.761779+0000 mon.a (mon.0) 431 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-10T09:05:08.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.300919+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:08.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.602745+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:08.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.607984+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:05:08.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.611413+0000 mon.b (mon.2) 300 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:08.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.612720+0000 mon.b (mon.2) 301 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:08.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.613851+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:08.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.615212+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:07.438141+0000 mgr.y (mgr.25069) 227 : cluster [DBG] pgmap v123: 129 pgs: 23 active+undersized+degraded, 27 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 79/609 objects degraded (12.972%) 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.615448+0000 mgr.y (mgr.25069) 228 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:07.616177+0000 mgr.y (mgr.25069) 229 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.631596+0000 mon.a (mon.0) 434 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:07.631666+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.638939+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:07.639658+0000 mon.a (mon.0) 436 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:08.299187+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 4 pgs peering) 2024-02-10T09:05:08.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:07.438141+0000 mgr.y (mgr.25069) 227 : cluster [DBG] pgmap v123: 129 pgs: 23 active+undersized+degraded, 27 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 79/609 objects degraded (12.972%) 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.615448+0000 mgr.y (mgr.25069) 228 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:07.616177+0000 mgr.y (mgr.25069) 229 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.631596+0000 mon.a (mon.0) 434 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:07.631666+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.638939+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:07.639658+0000 mon.a (mon.0) 436 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:05:08.927 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:08.299187+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 4 pgs peering) 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:07.438141+0000 mgr.y (mgr.25069) 227 : cluster [DBG] pgmap v123: 129 pgs: 23 active+undersized+degraded, 27 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 79/609 objects degraded (12.972%) 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.615448+0000 mgr.y (mgr.25069) 228 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:07.616177+0000 mgr.y (mgr.25069) 229 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.631596+0000 mon.a (mon.0) 434 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:07.631666+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.638939+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:07.639658+0000 mon.a (mon.0) 436 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-02-10T09:05:09.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:08.299187+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 4 pgs peering) 2024-02-10T09:05:09.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:08.629417+0000 mon.a (mon.0) 438 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:08.633449+0000 mon.a (mon.0) 439 : cluster [INF] osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657] boot 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:08.633502+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:08.635420+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:09.638076+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:08.629417+0000 mon.a (mon.0) 438 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:08.633449+0000 mon.a (mon.0) 439 : cluster [INF] osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657] boot 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:08.633502+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:08.635420+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T09:05:09.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:09.638076+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-10T09:05:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:08.629417+0000 mon.a (mon.0) 438 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:05:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:08.633449+0000 mon.a (mon.0) 439 : cluster [INF] osd.3 [v2:172.21.15.40:6826/2525502657,v1:172.21.15.40:6827/2525502657] boot 2024-02-10T09:05:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:08.633502+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-10T09:05:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:08.635420+0000 mon.b (mon.2) 304 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-10T09:05:10.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:09.638076+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-10T09:05:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:09.438889+0000 mgr.y (mgr.25069) 230 : cluster [DBG] pgmap v126: 129 pgs: 7 peering, 20 active+undersized+degraded, 23 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:05:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:09.645394+0000 mon.a (mon.0) 442 : cluster [WRN] Health check update: Degraded data redundancy: 69/609 objects degraded (11.330%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:10.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:09.438889+0000 mgr.y (mgr.25069) 230 : cluster [DBG] pgmap v126: 129 pgs: 7 peering, 20 active+undersized+degraded, 23 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:05:10.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:09.645394+0000 mon.a (mon.0) 442 : cluster [WRN] Health check update: Degraded data redundancy: 69/609 objects degraded (11.330%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:11.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:09.438889+0000 mgr.y (mgr.25069) 230 : cluster [DBG] pgmap v126: 129 pgs: 7 peering, 20 active+undersized+degraded, 23 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:05:11.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:09.645394+0000 mon.a (mon.0) 442 : cluster [WRN] Health check update: Degraded data redundancy: 69/609 objects degraded (11.330%), 20 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:12.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:11.439676+0000 mgr.y (mgr.25069) 231 : cluster [DBG] pgmap v128: 129 pgs: 7 peering, 17 active+undersized+degraded, 20 active+undersized, 85 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 55/609 objects degraded (9.031%) 2024-02-10T09:05:12.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:11.671598+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:12.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:11.439676+0000 mgr.y (mgr.25069) 231 : cluster [DBG] pgmap v128: 129 pgs: 7 peering, 17 active+undersized+degraded, 20 active+undersized, 85 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 55/609 objects degraded (9.031%) 2024-02-10T09:05:12.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:11.671598+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:13.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:11.439676+0000 mgr.y (mgr.25069) 231 : cluster [DBG] pgmap v128: 129 pgs: 7 peering, 17 active+undersized+degraded, 20 active+undersized, 85 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 55/609 objects degraded (9.031%) 2024-02-10T09:05:13.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:11.671598+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:14.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:13.754369+0000 mon.a (mon.0) 444 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/609 objects degraded (9.031%), 17 pgs degraded) 2024-02-10T09:05:14.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:13.754442+0000 mon.a (mon.0) 445 : cluster [INF] Cluster is now healthy 2024-02-10T09:05:14.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:13.754369+0000 mon.a (mon.0) 444 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/609 objects degraded (9.031%), 17 pgs degraded) 2024-02-10T09:05:14.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:13.754442+0000 mon.a (mon.0) 445 : cluster [INF] Cluster is now healthy 2024-02-10T09:05:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:13.754369+0000 mon.a (mon.0) 444 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/609 objects degraded (9.031%), 17 pgs degraded) 2024-02-10T09:05:14.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:13.754442+0000 mon.a (mon.0) 445 : cluster [INF] Cluster is now healthy 2024-02-10T09:05:15.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:13.440447+0000 mgr.y (mgr.25069) 232 : cluster [DBG] pgmap v129: 129 pgs: 7 peering, 122 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:15.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:13.440447+0000 mgr.y (mgr.25069) 232 : cluster [DBG] pgmap v129: 129 pgs: 7 peering, 122 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:13.440447+0000 mgr.y (mgr.25069) 232 : cluster [DBG] pgmap v129: 129 pgs: 7 peering, 122 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:17.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:15.441108+0000 mgr.y (mgr.25069) 233 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:17.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:15.441108+0000 mgr.y (mgr.25069) 233 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:15.441108+0000 mgr.y (mgr.25069) 233 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:17.441996+0000 mgr.y (mgr.25069) 234 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:19.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:17.441996+0000 mgr.y (mgr.25069) 234 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:17.441996+0000 mgr.y (mgr.25069) 234 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:19.442732+0000 mgr.y (mgr.25069) 235 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:21.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:19.442732+0000 mgr.y (mgr.25069) 235 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:19.442732+0000 mgr.y (mgr.25069) 235 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:21.443336+0000 mgr.y (mgr.25069) 236 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:21.686387+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:23.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:22.624738+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:21.443336+0000 mgr.y (mgr.25069) 236 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:21.686387+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:22.624738+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:23.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:21.443336+0000 mgr.y (mgr.25069) 236 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:23.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:21.686387+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:23.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:22.624738+0000 mon.b (mon.2) 305 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:23.735 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:05:24.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:22.625156+0000 mgr.y (mgr.25069) 237 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:24.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:22.626529+0000 mgr.y (mgr.25069) 238 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-10T09:05:24.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:22.625156+0000 mgr.y (mgr.25069) 237 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:24.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:22.626529+0000 mgr.y (mgr.25069) 238 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-10T09:05:24.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:22.625156+0000 mgr.y (mgr.25069) 237 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-10T09:05:24.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:22.626529+0000 mgr.y (mgr.25069) 238 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (5m) 17s ago 29m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (5m) 3m ago 28m 46.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (6m) 3m ago 32m 381M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (15m) 17s ago 34m 427M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (4m) 17s ago 34m 72.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (4m) 3m ago 32m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (3m) 17s ago 32m 63.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (6m) 17s ago 29m 13.4M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:05:24.391 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (6m) 3m ago 29m 23.2M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (2m) 17s ago 32m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (2m) 17s ago 31m 40.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (71s) 17s ago 31m 41.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (21s) 17s ago 31m 15.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (30m) 3m ago 30m 49.6M 4096M 15.2.0 204a01f9b0b6 b098e00a569d 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (30m) 3m ago 30m 45.5M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (30m) 3m ago 30m 45.4M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (29m) 3m ago 29m 46.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (5m) 3m ago 29m 49.8M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (27m) 17s ago 27m 41.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (27m) 3m ago 27m 39.5M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:05:24.780 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:05:24.780 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:05:24.781 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2024-02-10T09:05:24.782 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 9 2024-02-10T09:05:24.782 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:05:24.782 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "4/8 daemons upgraded", 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:05:25.112 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:05:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:23.443890+0000 mgr.y (mgr.25069) 239 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:23.723652+0000 mgr.y (mgr.25069) 240 : audit [DBG] from='client.64342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:24.054979+0000 mgr.y (mgr.25069) 241 : cephadm [INF] Upgrade: Updating osd.4 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.056984+0000 mgr.y (mgr.25069) 242 : audit [DBG] from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.060732+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.061736+0000 mon.b (mon.2) 306 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.062343+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:24.063458+0000 mgr.y (mgr.25069) 243 : cephadm [INF] Deploying daemon osd.4 on smithi145 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.063821+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.381451+0000 mon.b (mon.2) 309 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.381864+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.382153+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.382447+0000 mon.b (mon.2) 312 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.382719+0000 mon.b (mon.2) 313 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.382978+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.384638+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.384972+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.385249+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.385526+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.385786+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:25 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.780639+0000 mon.a (mon.0) 448 : audit [DBG] from='client.64360 172.21.15.40:0/544075581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:23.443890+0000 mgr.y (mgr.25069) 239 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:23.723652+0000 mgr.y (mgr.25069) 240 : audit [DBG] from='client.64342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:24.054979+0000 mgr.y (mgr.25069) 241 : cephadm [INF] Upgrade: Updating osd.4 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.056984+0000 mgr.y (mgr.25069) 242 : audit [DBG] from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.060732+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.061736+0000 mon.b (mon.2) 306 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.062343+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:24.063458+0000 mgr.y (mgr.25069) 243 : cephadm [INF] Deploying daemon osd.4 on smithi145 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.063821+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.381451+0000 mon.b (mon.2) 309 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.381864+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.382153+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.382447+0000 mon.b (mon.2) 312 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.382719+0000 mon.b (mon.2) 313 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.382978+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.384638+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.384972+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.385249+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.385526+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.385786+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.780639+0000 mon.a (mon.0) 448 : audit [DBG] from='client.64360 172.21.15.40:0/544075581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:25.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:23.443890+0000 mgr.y (mgr.25069) 239 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:23.723652+0000 mgr.y (mgr.25069) 240 : audit [DBG] from='client.64342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:24.054979+0000 mgr.y (mgr.25069) 241 : cephadm [INF] Upgrade: Updating osd.4 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.056984+0000 mgr.y (mgr.25069) 242 : audit [DBG] from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.060732+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.061736+0000 mon.b (mon.2) 306 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.062343+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:24.063458+0000 mgr.y (mgr.25069) 243 : cephadm [INF] Deploying daemon osd.4 on smithi145 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.063821+0000 mon.b (mon.2) 308 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.381451+0000 mon.b (mon.2) 309 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.381864+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.382153+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.382447+0000 mon.b (mon.2) 312 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.382719+0000 mon.b (mon.2) 313 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.382978+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.384638+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:25.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.384972+0000 mon.b (mon.2) 316 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.385249+0000 mon.b (mon.2) 317 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.385526+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.385786+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:25.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:25 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.780639+0000 mon.a (mon.0) 448 : audit [DBG] from='client.64360 172.21.15.40:0/544075581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:26.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:24.379520+0000 mgr.y (mgr.25069) 244 : audit [DBG] from='client.54411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:26.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:25.111811+0000 mgr.y (mgr.25069) 245 : audit [DBG] from='client.54423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:26.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:24.379520+0000 mgr.y (mgr.25069) 244 : audit [DBG] from='client.54411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:26.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:25.111811+0000 mgr.y (mgr.25069) 245 : audit [DBG] from='client.54423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:24.379520+0000 mgr.y (mgr.25069) 244 : audit [DBG] from='client.54411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:26.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:25.111811+0000 mgr.y (mgr.25069) 245 : audit [DBG] from='client.54423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:26.752 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:26 smithi145 systemd[1]: Stopping Ceph osd.4 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:05:27.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:26 smithi145 bash[38246]: debug 2024-02-10T09:05:26.751+0000 7fad52553700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:05:27.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:26 smithi145 bash[38246]: debug 2024-02-10T09:05:26.751+0000 7fad52553700 -1 osd.4 86 *** Got signal Terminated *** 2024-02-10T09:05:27.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:26 smithi145 bash[38246]: debug 2024-02-10T09:05:26.751+0000 7fad52553700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:05:27.377 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:27 smithi145 bash[63242]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.4 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:25.444331+0000 mgr.y (mgr.25069) 246 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:26.799909+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:26.799940+0000 mon.a (mon.0) 450 : cluster [INF] osd.4 failed (root=default,host=smithi145) (connection refused reported by osd.1) 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:26.800145+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:26.800305+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:26.800473+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.000178+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.000380+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.000609+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.000794+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.000979+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.6 2024-02-10T09:05:27.378 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.001092+0000 mon.a (mon.0) 459 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.001279+0000 mon.a (mon.0) 460 : cluster [DBG] osd.4 reported immediately failed by osd.7 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.001413+0000 mon.a (mon.0) 461 : cluster [DBG] osd.4 reported immediately failed by osd.6 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.001508+0000 mon.a (mon.0) 462 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.001690+0000 mon.a (mon.0) 463 : cluster [DBG] osd.4 reported immediately failed by osd.7 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.001857+0000 mon.a (mon.0) 464 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.002003+0000 mon.a (mon.0) 465 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.002179+0000 mon.a (mon.0) 466 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.379 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.002271+0000 mon.a (mon.0) 467 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-10T09:05:27.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:25.444331+0000 mgr.y (mgr.25069) 246 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:26.799909+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:26.799940+0000 mon.a (mon.0) 450 : cluster [INF] osd.4 failed (root=default,host=smithi145) (connection refused reported by osd.1) 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:26.800145+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:26.800305+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:26.800473+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.000178+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.000380+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.000609+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.000794+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.000979+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.6 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.001092+0000 mon.a (mon.0) 459 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.001279+0000 mon.a (mon.0) 460 : cluster [DBG] osd.4 reported immediately failed by osd.7 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.001413+0000 mon.a (mon.0) 461 : cluster [DBG] osd.4 reported immediately failed by osd.6 2024-02-10T09:05:27.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.001508+0000 mon.a (mon.0) 462 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.001690+0000 mon.a (mon.0) 463 : cluster [DBG] osd.4 reported immediately failed by osd.7 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.001857+0000 mon.a (mon.0) 464 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.002003+0000 mon.a (mon.0) 465 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.002179+0000 mon.a (mon.0) 466 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.002271+0000 mon.a (mon.0) 467 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:25.444331+0000 mgr.y (mgr.25069) 246 : cluster [DBG] pgmap v135: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:26.799909+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:26.799940+0000 mon.a (mon.0) 450 : cluster [INF] osd.4 failed (root=default,host=smithi145) (connection refused reported by osd.1) 2024-02-10T09:05:27.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:26.800145+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:26.800305+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:26.800473+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.000178+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.000380+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.000609+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.000794+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.000979+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.6 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.001092+0000 mon.a (mon.0) 459 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.001279+0000 mon.a (mon.0) 460 : cluster [DBG] osd.4 reported immediately failed by osd.7 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.001413+0000 mon.a (mon.0) 461 : cluster [DBG] osd.4 reported immediately failed by osd.6 2024-02-10T09:05:27.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.001508+0000 mon.a (mon.0) 462 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-10T09:05:27.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.001690+0000 mon.a (mon.0) 463 : cluster [DBG] osd.4 reported immediately failed by osd.7 2024-02-10T09:05:27.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.001857+0000 mon.a (mon.0) 464 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.002003+0000 mon.a (mon.0) 465 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-10T09:05:27.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.002179+0000 mon.a (mon.0) 466 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-10T09:05:27.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.002271+0000 mon.a (mon.0) 467 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-10T09:05:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.063621+0000 mon.a (mon.0) 468 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.069733+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2024-02-10T09:05:28.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:28.070039+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-10T09:05:28.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.063621+0000 mon.a (mon.0) 468 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:28.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.069733+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2024-02-10T09:05:28.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:28.070039+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-10T09:05:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.063621+0000 mon.a (mon.0) 468 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.069733+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2024-02-10T09:05:28.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:28.070039+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-10T09:05:29.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:27.444809+0000 mgr.y (mgr.25069) 247 : cluster [DBG] pgmap v137: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:29.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:27.444809+0000 mgr.y (mgr.25069) 247 : cluster [DBG] pgmap v137: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:29.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:27.444809+0000 mgr.y (mgr.25069) 247 : cluster [DBG] pgmap v137: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-10T09:05:29.533 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:29 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.4.service: Succeeded. 2024-02-10T09:05:29.533 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:29 smithi145 systemd[1]: Stopped Ceph osd.4 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:05:29.533 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:29 smithi145 systemd[1]: Starting Ceph osd.4 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:05:30.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:30.095457+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Degraded data redundancy: 12/609 objects degraded (1.970%), 3 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:30.282 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:05:30.282 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-10T09:05:30.282 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-10T09:05:30.283 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-10T09:05:30.283 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-10T09:05:30.283 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-10T09:05:30.283 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-10T09:05:30.283 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:30 smithi145 bash[63545]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-10T09:05:30.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:30.095457+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Degraded data redundancy: 12/609 objects degraded (1.970%), 3 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:30.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:30.095457+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: Degraded data redundancy: 12/609 objects degraded (1.970%), 3 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:31.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:29.445452+0000 mgr.y (mgr.25069) 248 : cluster [DBG] pgmap v139: 129 pgs: 3 active+undersized+degraded, 8 peering, 11 stale+active+clean, 6 active+undersized, 101 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 12/609 objects degraded (1.970%) 2024-02-10T09:05:31.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:29.445452+0000 mgr.y (mgr.25069) 248 : cluster [DBG] pgmap v139: 129 pgs: 3 active+undersized+degraded, 8 peering, 11 stale+active+clean, 6 active+undersized, 101 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 12/609 objects degraded (1.970%) 2024-02-10T09:05:31.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:29.445452+0000 mgr.y (mgr.25069) 248 : cluster [DBG] pgmap v139: 129 pgs: 3 active+undersized+degraded, 8 peering, 11 stale+active+clean, 6 active+undersized, 101 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 12/609 objects degraded (1.970%) 2024-02-10T09:05:31.532 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:05:31.139+0000 7fa5197a8700 1 -- 172.21.15.145:0/517440756 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559e97caa680 con 0x559e97c71000 2024-02-10T09:05:31.532 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:31 smithi145 bash[63790]: 6d72329fd65e2662c5f428ce3becb16af59a477421ca87b88e2f95249c383ed9 2024-02-10T09:05:31.532 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:31 smithi145 systemd[1]: Started Ceph osd.4 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:05:32.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:05:31.658+0000 7fa521236380 -1 Falling back to public interface 2024-02-10T09:05:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:31.266369+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:31.268378+0000 mon.b (mon.2) 320 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:05:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:31.445998+0000 mgr.y (mgr.25069) 249 : cluster [DBG] pgmap v140: 129 pgs: 9 active+undersized+degraded, 8 peering, 9 stale+active+clean, 9 active+undersized, 94 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:05:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:31.266369+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:31.268378+0000 mon.b (mon.2) 320 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:05:32.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:31.445998+0000 mgr.y (mgr.25069) 249 : cluster [DBG] pgmap v140: 129 pgs: 9 active+undersized+degraded, 8 peering, 9 stale+active+clean, 9 active+undersized, 94 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:05:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:31.266369+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:31.268378+0000 mon.b (mon.2) 320 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:05:32.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:31.445998+0000 mgr.y (mgr.25069) 249 : cluster [DBG] pgmap v140: 129 pgs: 9 active+undersized+degraded, 8 peering, 9 stale+active+clean, 9 active+undersized, 94 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:05:34.782 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:05:34.408+0000 7fa521236380 -1 osd.4 86 log_to_monitors {default=true} 2024-02-10T09:05:35.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:33.446888+0000 mgr.y (mgr.25069) 250 : cluster [DBG] pgmap v141: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 103/609 objects degraded (16.913%) 2024-02-10T09:05:35.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:34.411727+0000 mon.b (mon.2) 321 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T09:05:35.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:34.412125+0000 mon.a (mon.0) 473 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T09:05:35.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:33.446888+0000 mgr.y (mgr.25069) 250 : cluster [DBG] pgmap v141: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 103/609 objects degraded (16.913%) 2024-02-10T09:05:35.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:34.411727+0000 mon.b (mon.2) 321 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T09:05:35.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:34.412125+0000 mon.a (mon.0) 473 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T09:05:35.282 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:05:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:05:34.821+0000 7fa51271d700 -1 osd.4 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:05:35.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:33.446888+0000 mgr.y (mgr.25069) 250 : cluster [DBG] pgmap v141: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 103/609 objects degraded (16.913%) 2024-02-10T09:05:35.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:34.411727+0000 mon.b (mon.2) 321 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T09:05:35.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:34.412125+0000 mon.a (mon.0) 473 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-10T09:05:36.176 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:05:35.719+0000 7f95858b4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:34.797240+0000 mon.a (mon.0) 474 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:34.797346+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:34.797952+0000 mon.b (mon.2) 322 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:34.798360+0000 mon.a (mon.0) 476 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.702006+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.707582+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.713327+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.716466+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.717925+0000 mon.b (mon.2) 325 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.719084+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.720659+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:34.797240+0000 mon.a (mon.0) 474 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:34.797346+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:34.797952+0000 mon.b (mon.2) 322 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:34.798360+0000 mon.a (mon.0) 476 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.702006+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.707582+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.713327+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.716466+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.717925+0000 mon.b (mon.2) 325 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.719084+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.720659+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:36.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:34.797240+0000 mon.a (mon.0) 474 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-10T09:05:36.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:34.797346+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-10T09:05:36.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:34.797952+0000 mon.b (mon.2) 322 : audit [INF] from='osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:05:36.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:34.798360+0000 mon.a (mon.0) 476 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:05:36.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.702006+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:36.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.707582+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:36.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.713327+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:05:36.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.716466+0000 mon.b (mon.2) 324 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.717925+0000 mon.b (mon.2) 325 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.719084+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:36.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.720659+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:35.447438+0000 mgr.y (mgr.25069) 251 : cluster [DBG] pgmap v143: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 103/609 objects degraded (16.913%) 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.720902+0000 mgr.y (mgr.25069) 252 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:35.721727+0000 mgr.y (mgr.25069) 253 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:35.799877+0000 mon.a (mon.0) 479 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:35.810295+0000 mon.a (mon.0) 480 : cluster [INF] osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380] boot 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:35.810349+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:35.814928+0000 mon.b (mon.2) 328 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T09:05:37.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:35.447438+0000 mgr.y (mgr.25069) 251 : cluster [DBG] pgmap v143: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 103/609 objects degraded (16.913%) 2024-02-10T09:05:37.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.720902+0000 mgr.y (mgr.25069) 252 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:37.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:35.721727+0000 mgr.y (mgr.25069) 253 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:05:37.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:35.799877+0000 mon.a (mon.0) 479 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:05:37.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:35.810295+0000 mon.a (mon.0) 480 : cluster [INF] osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380] boot 2024-02-10T09:05:37.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:35.810349+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-10T09:05:37.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:35.814928+0000 mon.b (mon.2) 328 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T09:05:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:35.447438+0000 mgr.y (mgr.25069) 251 : cluster [DBG] pgmap v143: 129 pgs: 23 active+undersized+degraded, 33 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 103/609 objects degraded (16.913%) 2024-02-10T09:05:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.720902+0000 mgr.y (mgr.25069) 252 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:35.721727+0000 mgr.y (mgr.25069) 253 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:05:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:35.799877+0000 mon.a (mon.0) 479 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:05:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:35.810295+0000 mon.a (mon.0) 480 : cluster [INF] osd.4 [v2:172.21.15.145:6800/3221832380,v1:172.21.15.145:6801/3221832380] boot 2024-02-10T09:05:37.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:35.810349+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-10T09:05:37.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:35.814928+0000 mon.b (mon.2) 328 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-10T09:05:38.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:36.816079+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-10T09:05:38.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:37.785647+0000 mon.a (mon.0) 483 : cluster [WRN] Health check update: Degraded data redundancy: 103/609 objects degraded (16.913%), 23 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:36.816079+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-10T09:05:38.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:37.785647+0000 mon.a (mon.0) 483 : cluster [WRN] Health check update: Degraded data redundancy: 103/609 objects degraded (16.913%), 23 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:38.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:36.816079+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-10T09:05:38.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:37.785647+0000 mon.a (mon.0) 483 : cluster [WRN] Health check update: Degraded data redundancy: 103/609 objects degraded (16.913%), 23 pgs degraded (PG_DEGRADED) 2024-02-10T09:05:39.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:37.448091+0000 mgr.y (mgr.25069) 254 : cluster [DBG] pgmap v146: 129 pgs: 27 peering, 10 active+undersized+degraded, 18 active+undersized, 74 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:05:39.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:37.448091+0000 mgr.y (mgr.25069) 254 : cluster [DBG] pgmap v146: 129 pgs: 27 peering, 10 active+undersized+degraded, 18 active+undersized, 74 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:05:39.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:37.448091+0000 mgr.y (mgr.25069) 254 : cluster [DBG] pgmap v146: 129 pgs: 27 peering, 10 active+undersized+degraded, 18 active+undersized, 74 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 38/609 objects degraded (6.240%) 2024-02-10T09:05:41.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:39.448768+0000 mgr.y (mgr.25069) 255 : cluster [DBG] pgmap v147: 129 pgs: 27 peering, 8 active+undersized+degraded, 10 active+undersized, 84 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 27/609 objects degraded (4.433%) 2024-02-10T09:05:41.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:39.448768+0000 mgr.y (mgr.25069) 255 : cluster [DBG] pgmap v147: 129 pgs: 27 peering, 8 active+undersized+degraded, 10 active+undersized, 84 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 27/609 objects degraded (4.433%) 2024-02-10T09:05:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:39.448768+0000 mgr.y (mgr.25069) 255 : cluster [DBG] pgmap v147: 129 pgs: 27 peering, 8 active+undersized+degraded, 10 active+undersized, 84 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 27/609 objects degraded (4.433%) 2024-02-10T09:05:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:41.449325+0000 mgr.y (mgr.25069) 256 : cluster [DBG] pgmap v148: 129 pgs: 20 peering, 109 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:41.703551+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:41.835712+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/609 objects degraded (4.433%), 8 pgs degraded) 2024-02-10T09:05:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:41.835751+0000 mon.a (mon.0) 486 : cluster [INF] Cluster is now healthy 2024-02-10T09:05:43.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:41.449325+0000 mgr.y (mgr.25069) 256 : cluster [DBG] pgmap v148: 129 pgs: 20 peering, 109 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:41.703551+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:41.835712+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/609 objects degraded (4.433%), 8 pgs degraded) 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:41.835751+0000 mon.a (mon.0) 486 : cluster [INF] Cluster is now healthy 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:41.449325+0000 mgr.y (mgr.25069) 256 : cluster [DBG] pgmap v148: 129 pgs: 20 peering, 109 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:41.703551+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:41.835712+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/609 objects degraded (4.433%), 8 pgs degraded) 2024-02-10T09:05:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:41.835751+0000 mon.a (mon.0) 486 : cluster [INF] Cluster is now healthy 2024-02-10T09:05:45.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:43.450011+0000 mgr.y (mgr.25069) 257 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:45.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:43.450011+0000 mgr.y (mgr.25069) 257 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:43.450011+0000 mgr.y (mgr.25069) 257 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:47.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:45.450542+0000 mgr.y (mgr.25069) 258 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:47.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:45.450542+0000 mgr.y (mgr.25069) 258 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:47.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:45.450542+0000 mgr.y (mgr.25069) 258 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:49.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:47.451149+0000 mgr.y (mgr.25069) 259 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:47.451149+0000 mgr.y (mgr.25069) 259 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:47.451149+0000 mgr.y (mgr.25069) 259 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:51.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:49.451896+0000 mgr.y (mgr.25069) 260 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:51.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:50.737610+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:49.451896+0000 mgr.y (mgr.25069) 260 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:50.737610+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:51.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:49.451896+0000 mgr.y (mgr.25069) 260 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:51.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:50.737610+0000 mon.b (mon.2) 329 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:52.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:50.738107+0000 mgr.y (mgr.25069) 261 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:52.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:50.739522+0000 mgr.y (mgr.25069) 262 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-10T09:05:52.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:51.717118+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:52.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:50.738107+0000 mgr.y (mgr.25069) 261 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:52.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:50.739522+0000 mgr.y (mgr.25069) 262 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-10T09:05:52.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:51.717118+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:50.738107+0000 mgr.y (mgr.25069) 261 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-10T09:05:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:50.739522+0000 mgr.y (mgr.25069) 262 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-10T09:05:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:51.717118+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:51.452555+0000 mgr.y (mgr.25069) 263 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:52.188119+0000 mgr.y (mgr.25069) 264 : cephadm [INF] Upgrade: Updating osd.5 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:52.193351+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:52.194404+0000 mon.b (mon.2) 330 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:52.195072+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:05:52.196433+0000 mgr.y (mgr.25069) 265 : cephadm [INF] Deploying daemon osd.5 on smithi145 2024-02-10T09:05:53.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:52.196908+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-10T09:05:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:51.452555+0000 mgr.y (mgr.25069) 263 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:53.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:52.188119+0000 mgr.y (mgr.25069) 264 : cephadm [INF] Upgrade: Updating osd.5 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:52.193351+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:52.194404+0000 mon.b (mon.2) 330 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:52.195072+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:05:52.196433+0000 mgr.y (mgr.25069) 265 : cephadm [INF] Deploying daemon osd.5 on smithi145 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:52.196908+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:51.452555+0000 mgr.y (mgr.25069) 263 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:52.188119+0000 mgr.y (mgr.25069) 264 : cephadm [INF] Upgrade: Updating osd.5 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:52.193351+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:52.194404+0000 mon.b (mon.2) 330 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:52.195072+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:05:53.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:05:52.196433+0000 mgr.y (mgr.25069) 265 : cephadm [INF] Deploying daemon osd.5 on smithi145 2024-02-10T09:05:53.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:52.196908+0000 mon.b (mon.2) 332 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-10T09:05:55.196 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:55 smithi145 systemd[1]: Stopping Ceph osd.5 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:05:55.464 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:05:55.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:53.453163+0000 mgr.y (mgr.25069) 266 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:55.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:55 smithi145 bash[39917]: debug 2024-02-10T09:05:55.216+0000 7fb0004d5700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:05:55.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:55 smithi145 bash[39917]: debug 2024-02-10T09:05:55.216+0000 7fb0004d5700 -1 osd.5 91 *** Got signal Terminated *** 2024-02-10T09:05:55.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:55 smithi145 bash[39917]: debug 2024-02-10T09:05:55.216+0000 7fb0004d5700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:05:55.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:53.453163+0000 mgr.y (mgr.25069) 266 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:55.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:53.453163+0000 mgr.y (mgr.25069) 266 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:56.007 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:55 smithi145 bash[64902]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.5 2024-02-10T09:05:56.127 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (6m) 48s ago 29m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (5m) 20s ago 29m 57.2M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (6m) 20s ago 32m 384M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (16m) 48s ago 34m 427M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (4m) 48s ago 34m 72.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (5m) 20s ago 33m 69.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (4m) 48s ago 33m 63.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (6m) 48s ago 29m 13.4M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (6m) 20s ago 29m 23.7M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (3m) 48s ago 32m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (2m) 48s ago 32m 40.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:05:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (103s) 48s ago 32m 41.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (52s) 48s ago 31m 15.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (25s) 20s ago 31m 10.6M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (31m) 20s ago 31m 49.7M 4096M 15.2.0 204a01f9b0b6 b91a5ba45b8a 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (30m) 20s ago 30m 48.7M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (30m) 20s ago 30m 51.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (6m) 20s ago 29m 58.9M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (27m) 48s ago 27m 41.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:05:56.129 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (27m) 20s ago 27m 40.7M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:05:56.524 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:05:56.524 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:05:56.524 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:05:56.524 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:56.524 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 10 2024-02-10T09:05:56.525 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:05:56.526 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:05:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.471333+0000 mon.a (mon.0) 489 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.471372+0000 mon.a (mon.0) 490 : cluster [INF] osd.5 failed (root=default,host=smithi145) (connection refused reported by osd.6) 2024-02-10T09:05:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.471593+0000 mon.a (mon.0) 491 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.471731+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.471915+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.471990+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472142+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472247+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472361+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472465+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472594+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472674+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472811+0000 mon.a (mon.0) 501 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.472939+0000 mon.a (mon.0) 502 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.473069+0000 mon.a (mon.0) 503 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.872466+0000 mon.a (mon.0) 504 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.872531+0000 mon.a (mon.0) 505 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.872797+0000 mon.a (mon.0) 506 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.872936+0000 mon.a (mon.0) 507 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873081+0000 mon.a (mon.0) 508 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873128+0000 mon.a (mon.0) 509 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873264+0000 mon.a (mon.0) 510 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873387+0000 mon.a (mon.0) 511 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873429+0000 mon.a (mon.0) 512 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873564+0000 mon.a (mon.0) 513 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873687+0000 mon.a (mon.0) 514 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873797+0000 mon.a (mon.0) 515 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.873929+0000 mon.a (mon.0) 516 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.874037+0000 mon.a (mon.0) 517 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.116591+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.117307+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.117788+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.118230+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.118697+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.119100+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.120845+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.121338+0000 mon.b (mon.2) 340 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.121955+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.122339+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.122716+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.471333+0000 mon.a (mon.0) 489 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.471372+0000 mon.a (mon.0) 490 : cluster [INF] osd.5 failed (root=default,host=smithi145) (connection refused reported by osd.6) 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.471593+0000 mon.a (mon.0) 491 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.471731+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.471915+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.471990+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472142+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472247+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472361+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472465+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472594+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472674+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472811+0000 mon.a (mon.0) 501 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.472939+0000 mon.a (mon.0) 502 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.473069+0000 mon.a (mon.0) 503 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.872466+0000 mon.a (mon.0) 504 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.872531+0000 mon.a (mon.0) 505 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.872797+0000 mon.a (mon.0) 506 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.872936+0000 mon.a (mon.0) 507 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873081+0000 mon.a (mon.0) 508 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.471333+0000 mon.a (mon.0) 489 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.471372+0000 mon.a (mon.0) 490 : cluster [INF] osd.5 failed (root=default,host=smithi145) (connection refused reported by osd.6) 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.471593+0000 mon.a (mon.0) 491 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.471731+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.471915+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.471990+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472142+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472247+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472361+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472465+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472594+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472674+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472811+0000 mon.a (mon.0) 501 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.472939+0000 mon.a (mon.0) 502 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.473069+0000 mon.a (mon.0) 503 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.872466+0000 mon.a (mon.0) 504 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.872531+0000 mon.a (mon.0) 505 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.872797+0000 mon.a (mon.0) 506 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.872936+0000 mon.a (mon.0) 507 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873081+0000 mon.a (mon.0) 508 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873128+0000 mon.a (mon.0) 509 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873264+0000 mon.a (mon.0) 510 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873387+0000 mon.a (mon.0) 511 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873429+0000 mon.a (mon.0) 512 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873564+0000 mon.a (mon.0) 513 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.679 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873687+0000 mon.a (mon.0) 514 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873797+0000 mon.a (mon.0) 515 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.873929+0000 mon.a (mon.0) 516 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.874037+0000 mon.a (mon.0) 517 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.116591+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.117307+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.117788+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.118230+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.118697+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.119100+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.120845+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.121338+0000 mon.b (mon.2) 340 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.121955+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.122339+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.122716+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873128+0000 mon.a (mon.0) 509 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873264+0000 mon.a (mon.0) 510 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873387+0000 mon.a (mon.0) 511 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873429+0000 mon.a (mon.0) 512 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873564+0000 mon.a (mon.0) 513 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873687+0000 mon.a (mon.0) 514 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873797+0000 mon.a (mon.0) 515 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.873929+0000 mon.a (mon.0) 516 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.874037+0000 mon.a (mon.0) 517 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-10T09:05:56.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.116591+0000 mon.b (mon.2) 333 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.117307+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.117788+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.118230+0000 mon.b (mon.2) 336 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.118697+0000 mon.b (mon.2) 337 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.119100+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.120845+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.121338+0000 mon.b (mon.2) 340 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.121955+0000 mon.b (mon.2) 341 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.122339+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.682 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.122716+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:05:56.855 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:05:56.855 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:05:56.855 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:05:56.855 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-02-10T09:05:56.855 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:05:56.856 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "5/8 daemons upgraded", 2024-02-10T09:05:56.856 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:05:56.856 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:05:56.856 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:55.453097+0000 mgr.y (mgr.25069) 267 : audit [DBG] from='client.54429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:55.453536+0000 mgr.y (mgr.25069) 268 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:55.787615+0000 mgr.y (mgr.25069) 269 : audit [DBG] from='client.54435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.114592+0000 mgr.y (mgr.25069) 270 : audit [DBG] from='client.54441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:56.195727+0000 mon.a (mon.0) 518 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:56.204495+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-10T09:05:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.524143+0000 mon.c (mon.1) 13 : audit [DBG] from='client.64390 172.21.15.40:0/1672172649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:57.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:55.453097+0000 mgr.y (mgr.25069) 267 : audit [DBG] from='client.54429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:55.453536+0000 mgr.y (mgr.25069) 268 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:55.787615+0000 mgr.y (mgr.25069) 269 : audit [DBG] from='client.54435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.114592+0000 mgr.y (mgr.25069) 270 : audit [DBG] from='client.54441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:56.195727+0000 mon.a (mon.0) 518 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:56.204495+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.524143+0000 mon.c (mon.1) 13 : audit [DBG] from='client.64390 172.21.15.40:0/1672172649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:55.453097+0000 mgr.y (mgr.25069) 267 : audit [DBG] from='client.54429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:55.453536+0000 mgr.y (mgr.25069) 268 : cluster [DBG] pgmap v155: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:55.787615+0000 mgr.y (mgr.25069) 269 : audit [DBG] from='client.54435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.114592+0000 mgr.y (mgr.25069) 270 : audit [DBG] from='client.54441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:57.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:56.195727+0000 mon.a (mon.0) 518 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:05:57.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:56.204495+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-10T09:05:57.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.524143+0000 mon.c (mon.1) 13 : audit [DBG] from='client.64390 172.21.15.40:0/1672172649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:05:58.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:57 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.5.service: Succeeded. 2024-02-10T09:05:58.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:57 smithi145 systemd[1]: Stopped Ceph osd.5 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:05:58.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:57 smithi145 systemd[1]: Starting Ceph osd.5 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:05:58.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:56.855288+0000 mgr.y (mgr.25069) 271 : audit [DBG] from='client.54453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:58.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:57.213728+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-10T09:05:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:56.855288+0000 mgr.y (mgr.25069) 271 : audit [DBG] from='client.54453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:58.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:57.213728+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-10T09:05:58.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:56.855288+0000 mgr.y (mgr.25069) 271 : audit [DBG] from='client.54453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:05:58.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:57.213728+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-10T09:05:58.955 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:58 smithi145 bash[65203]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-10T09:05:59.528 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:57.454091+0000 mgr.y (mgr.25069) 272 : cluster [DBG] pgmap v158: 129 pgs: 18 peering, 12 stale+active+clean, 99 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:59.528 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:05:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:58.205897+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-02-10T09:05:59.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:57.454091+0000 mgr.y (mgr.25069) 272 : cluster [DBG] pgmap v158: 129 pgs: 18 peering, 12 stale+active+clean, 99 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:59.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:05:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:58.205897+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-02-10T09:05:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:57.454091+0000 mgr.y (mgr.25069) 272 : cluster [DBG] pgmap v158: 129 pgs: 18 peering, 12 stale+active+clean, 99 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-10T09:05:59.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:05:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:58.205897+0000 mon.a (mon.0) 521 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-02-10T09:06:00.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:05:59.646+0000 7f6535449700 1 -- 172.21.15.145:0/4030955434 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5590b599c680 con 0x5590b5963000 2024-02-10T09:06:00.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:59 smithi145 bash[65444]: 0c920d7faaee5e3711695e179e2887daaa63935b1ec3f9123f3c16746960c3c2 2024-02-10T09:06:00.032 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:05:59 smithi145 systemd[1]: Started Ceph osd.5 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:06:00.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:06:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:06:00.161+0000 7f653ced7380 -1 Falling back to public interface 2024-02-10T09:06:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:05:59.454786+0000 mgr.y (mgr.25069) 273 : cluster [DBG] pgmap v159: 129 pgs: 5 active+undersized+degraded, 18 peering, 5 stale+active+clean, 10 active+undersized, 91 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:06:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:59.779792+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:05:59.782056+0000 mon.b (mon.2) 344 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:01.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:00.212806+0000 mon.a (mon.0) 523 : cluster [WRN] Health check failed: Degraded data redundancy: 28/609 objects degraded (4.598%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:01.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:05:59.454786+0000 mgr.y (mgr.25069) 273 : cluster [DBG] pgmap v159: 129 pgs: 5 active+undersized+degraded, 18 peering, 5 stale+active+clean, 10 active+undersized, 91 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:06:01.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:59.779792+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:01.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:05:59.782056+0000 mon.b (mon.2) 344 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:01.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:00.212806+0000 mon.a (mon.0) 523 : cluster [WRN] Health check failed: Degraded data redundancy: 28/609 objects degraded (4.598%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:05:59.454786+0000 mgr.y (mgr.25069) 273 : cluster [DBG] pgmap v159: 129 pgs: 5 active+undersized+degraded, 18 peering, 5 stale+active+clean, 10 active+undersized, 91 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:06:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:59.779792+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:05:59.782056+0000 mon.b (mon.2) 344 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:00.212806+0000 mon.a (mon.0) 523 : cluster [WRN] Health check failed: Degraded data redundancy: 28/609 objects degraded (4.598%), 5 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:03.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:01.455545+0000 mgr.y (mgr.25069) 274 : cluster [DBG] pgmap v160: 129 pgs: 10 active+undersized+degraded, 18 peering, 16 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 50/609 objects degraded (8.210%) 2024-02-10T09:06:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:01.455545+0000 mgr.y (mgr.25069) 274 : cluster [DBG] pgmap v160: 129 pgs: 10 active+undersized+degraded, 18 peering, 16 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 50/609 objects degraded (8.210%) 2024-02-10T09:06:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:01.455545+0000 mgr.y (mgr.25069) 274 : cluster [DBG] pgmap v160: 129 pgs: 10 active+undersized+degraded, 18 peering, 16 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 50/609 objects degraded (8.210%) 2024-02-10T09:06:03.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:06:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:06:02.896+0000 7f653ced7380 -1 osd.5 91 log_to_monitors {default=true} 2024-02-10T09:06:04.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:02.900854+0000 mon.b (mon.2) 345 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T09:06:04.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:02.901301+0000 mon.a (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T09:06:04.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:02.900854+0000 mon.b (mon.2) 345 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T09:06:04.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:02.901301+0000 mon.a (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T09:06:04.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:06:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:06:03.825+0000 7f652ebbf700 -1 osd.5 91 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:06:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:02.900854+0000 mon.b (mon.2) 345 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T09:06:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:02.901301+0000 mon.a (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-10T09:06:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:03.456460+0000 mgr.y (mgr.25069) 275 : cluster [DBG] pgmap v161: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:06:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:03.792674+0000 mon.a (mon.0) 525 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 5 pgs peering) 2024-02-10T09:06:05.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:03.803251+0000 mon.a (mon.0) 526 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T09:06:05.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:03.803314+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-10T09:06:05.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:03.803998+0000 mon.b (mon.2) 346 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:05.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:03.804396+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:05.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:04.156527+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:05.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:04.158338+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2024-02-10T09:06:05.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:03.456460+0000 mgr.y (mgr.25069) 275 : cluster [DBG] pgmap v161: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:06:05.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:03.792674+0000 mon.a (mon.0) 525 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 5 pgs peering) 2024-02-10T09:06:05.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:03.803251+0000 mon.a (mon.0) 526 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T09:06:05.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:03.803314+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-10T09:06:05.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:03.803998+0000 mon.b (mon.2) 346 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:05.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:03.804396+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:04.156527+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:04.158338+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:03.456460+0000 mgr.y (mgr.25069) 275 : cluster [DBG] pgmap v161: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:03.792674+0000 mon.a (mon.0) 525 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 5 pgs peering) 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:03.803251+0000 mon.a (mon.0) 526 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:03.803314+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:03.803998+0000 mon.b (mon.2) 346 : audit [INF] from='osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:03.804396+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:04.156527+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:04.158338+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2024-02-10T09:06:06.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:04.800222+0000 mon.a (mon.0) 530 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:04.804901+0000 mon.b (mon.2) 348 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:04.805227+0000 mon.a (mon.0) 531 : cluster [INF] osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865] boot 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:04.805339+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:05.807859+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:04.800222+0000 mon.a (mon.0) 530 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:04.804901+0000 mon.b (mon.2) 348 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:04.805227+0000 mon.a (mon.0) 531 : cluster [INF] osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865] boot 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:04.805339+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-10T09:06:06.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:05.807859+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-10T09:06:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:04.800222+0000 mon.a (mon.0) 530 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:06:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:04.804901+0000 mon.b (mon.2) 348 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-10T09:06:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:04.805227+0000 mon.a (mon.0) 531 : cluster [INF] osd.5 [v2:172.21.15.145:6808/1831237865,v1:172.21.15.145:6809/1831237865] boot 2024-02-10T09:06:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:04.805339+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-10T09:06:06.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:05.807859+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-10T09:06:06.939 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:05.457095+0000 mgr.y (mgr.25069) 276 : cluster [DBG] pgmap v164: 129 pgs: 2 peering, 18 active+undersized+degraded, 24 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:06:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:05.457095+0000 mgr.y (mgr.25069) 276 : cluster [DBG] pgmap v164: 129 pgs: 2 peering, 18 active+undersized+degraded, 24 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:06:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:05.457095+0000 mgr.y (mgr.25069) 276 : cluster [DBG] pgmap v164: 129 pgs: 2 peering, 18 active+undersized+degraded, 24 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 69/609 objects degraded (11.330%) 2024-02-10T09:06:07.833 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:06:07.478+0000 7f95858b4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:06:08.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:06.957855+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:08.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.178774+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.465903+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.471512+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.475210+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.476652+0000 mon.b (mon.2) 352 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.477851+0000 mon.b (mon.2) 353 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.479431+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:07.791889+0000 mon.a (mon.0) 536 : cluster [WRN] Health check update: Degraded data redundancy: 69/609 objects degraded (11.330%), 18 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:06.957855+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.178774+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.465903+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:08.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.471512+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:06:08.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.475210+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.476652+0000 mon.b (mon.2) 352 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.477851+0000 mon.b (mon.2) 353 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.479431+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:08.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:07.791889+0000 mon.a (mon.0) 536 : cluster [WRN] Health check update: Degraded data redundancy: 69/609 objects degraded (11.330%), 18 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:06.957855+0000 mon.b (mon.2) 349 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.178774+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.465903+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.471512+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.475210+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.476652+0000 mon.b (mon.2) 352 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.477851+0000 mon.b (mon.2) 353 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:08.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.479431+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:08.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:07.791889+0000 mon.a (mon.0) 536 : cluster [WRN] Health check update: Degraded data redundancy: 69/609 objects degraded (11.330%), 18 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:07.457711+0000 mgr.y (mgr.25069) 277 : cluster [DBG] pgmap v166: 129 pgs: 2 peering, 9 active+undersized+degraded, 16 active+undersized, 102 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 46/609 objects degraded (7.553%) 2024-02-10T09:06:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:07.479653+0000 mgr.y (mgr.25069) 278 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:09.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:07.480533+0000 mgr.y (mgr.25069) 279 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:06:09.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:07.457711+0000 mgr.y (mgr.25069) 277 : cluster [DBG] pgmap v166: 129 pgs: 2 peering, 9 active+undersized+degraded, 16 active+undersized, 102 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 46/609 objects degraded (7.553%) 2024-02-10T09:06:09.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:07.479653+0000 mgr.y (mgr.25069) 278 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:09.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:07.480533+0000 mgr.y (mgr.25069) 279 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:06:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:07.457711+0000 mgr.y (mgr.25069) 277 : cluster [DBG] pgmap v166: 129 pgs: 2 peering, 9 active+undersized+degraded, 16 active+undersized, 102 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 46/609 objects degraded (7.553%) 2024-02-10T09:06:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:07.479653+0000 mgr.y (mgr.25069) 278 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:09.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:07.480533+0000 mgr.y (mgr.25069) 279 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-10T09:06:10.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:10.183561+0000 mon.a (mon.0) 537 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/609 objects degraded (7.553%), 9 pgs degraded) 2024-02-10T09:06:10.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:10.183597+0000 mon.a (mon.0) 538 : cluster [INF] Cluster is now healthy 2024-02-10T09:06:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:10.183561+0000 mon.a (mon.0) 537 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/609 objects degraded (7.553%), 9 pgs degraded) 2024-02-10T09:06:10.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:10.183597+0000 mon.a (mon.0) 538 : cluster [INF] Cluster is now healthy 2024-02-10T09:06:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:10.183561+0000 mon.a (mon.0) 537 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/609 objects degraded (7.553%), 9 pgs degraded) 2024-02-10T09:06:10.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:10.183597+0000 mon.a (mon.0) 538 : cluster [INF] Cluster is now healthy 2024-02-10T09:06:11.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:11 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:09.458464+0000 mgr.y (mgr.25069) 280 : cluster [DBG] pgmap v167: 129 pgs: 2 peering, 127 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:11.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:09.458464+0000 mgr.y (mgr.25069) 280 : cluster [DBG] pgmap v167: 129 pgs: 2 peering, 127 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:11.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:09.458464+0000 mgr.y (mgr.25069) 280 : cluster [DBG] pgmap v167: 129 pgs: 2 peering, 127 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:13.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:11.459038+0000 mgr.y (mgr.25069) 281 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:13.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:11.459038+0000 mgr.y (mgr.25069) 281 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:13.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:11.459038+0000 mgr.y (mgr.25069) 281 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:15.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:15 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:13.459624+0000 mgr.y (mgr.25069) 282 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:15.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:13.459624+0000 mgr.y (mgr.25069) 282 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:15.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:15 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:13.459624+0000 mgr.y (mgr.25069) 282 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:15.460347+0000 mgr.y (mgr.25069) 283 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:17.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:17 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:16.735713+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:15.460347+0000 mgr.y (mgr.25069) 283 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:17.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:16.735713+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:15.460347+0000 mgr.y (mgr.25069) 283 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:17.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:17 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:16.735713+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:17.461078+0000 mgr.y (mgr.25069) 284 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:19.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:17.461078+0000 mgr.y (mgr.25069) 284 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:17.461078+0000 mgr.y (mgr.25069) 284 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:19.461826+0000 mgr.y (mgr.25069) 285 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:19.461826+0000 mgr.y (mgr.25069) 285 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:19.461826+0000 mgr.y (mgr.25069) 285 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:21.462458+0000 mgr.y (mgr.25069) 286 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:22.495314+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:23.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:21.462458+0000 mgr.y (mgr.25069) 286 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:23.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:22.495314+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:21.462458+0000 mgr.y (mgr.25069) 286 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:22.495314+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:24.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:22.495795+0000 mgr.y (mgr.25069) 287 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:24.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:23 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:22.497332+0000 mgr.y (mgr.25069) 288 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-02-10T09:06:24.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:22.495795+0000 mgr.y (mgr.25069) 287 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:24.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:22.497332+0000 mgr.y (mgr.25069) 288 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-02-10T09:06:24.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:22.495795+0000 mgr.y (mgr.25069) 287 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-10T09:06:24.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:23 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:22.497332+0000 mgr.y (mgr.25069) 288 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:23.463044+0000 mgr.y (mgr.25069) 289 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:23.844724+0000 mgr.y (mgr.25069) 290 : cephadm [INF] Upgrade: Updating osd.6 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:23.850118+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:23.851108+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:23.851875+0000 mon.b (mon.2) 357 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:23.853311+0000 mgr.y (mgr.25069) 291 : cephadm [INF] Deploying daemon osd.6 on smithi145 2024-02-10T09:06:25.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:23.853815+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-10T09:06:25.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:23.463044+0000 mgr.y (mgr.25069) 289 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:25.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:23.844724+0000 mgr.y (mgr.25069) 290 : cephadm [INF] Upgrade: Updating osd.6 2024-02-10T09:06:25.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:23.850118+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:25.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:23.851108+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:23.851875+0000 mon.b (mon.2) 357 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:23.853311+0000 mgr.y (mgr.25069) 291 : cephadm [INF] Deploying daemon osd.6 on smithi145 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:23.853815+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:23.463044+0000 mgr.y (mgr.25069) 289 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:23.844724+0000 mgr.y (mgr.25069) 290 : cephadm [INF] Upgrade: Updating osd.6 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:23.850118+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:23.851108+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:23.851875+0000 mon.b (mon.2) 357 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:23.853311+0000 mgr.y (mgr.25069) 291 : cephadm [INF] Deploying daemon osd.6 on smithi145 2024-02-10T09:06:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:23.853815+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-10T09:06:26.633 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:26 smithi145 systemd[1]: Stopping Ceph osd.6 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:06:26.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:25.463626+0000 mgr.y (mgr.25069) 292 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:26.930 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:26 smithi145 bash[41353]: debug 2024-02-10T09:06:26.631+0000 7f3bf43ce700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:06:26.930 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:26 smithi145 bash[41353]: debug 2024-02-10T09:06:26.631+0000 7f3bf43ce700 -1 osd.6 96 *** Got signal Terminated *** 2024-02-10T09:06:26.930 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:26 smithi145 bash[41353]: debug 2024-02-10T09:06:26.631+0000 7f3bf43ce700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:06:27.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:25.463626+0000 mgr.y (mgr.25069) 292 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:27.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:25.463626+0000 mgr.y (mgr.25069) 292 : cluster [DBG] pgmap v175: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:06:27.258 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:27 smithi145 bash[67873]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.6 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (6m) 80s ago 30m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (6m) 23s ago 29m 57.3M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (7m) 23s ago 33m 384M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (17m) 80s ago 35m 427M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (5m) 80s ago 35m 72.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (5m) 23s ago 33m 67.1M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (4m) 80s ago 34m 63.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (7m) 80s ago 30m 13.4M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (7m) 23s ago 30m 22.7M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (3m) 80s ago 33m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (3m) 80s ago 32m 40.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:06:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (2m) 80s ago 32m 41.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (84s) 80s ago 32m 15.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (57s) 23s ago 31m 39.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (28s) 23s ago 31m 13.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (31m) 23s ago 31m 49.7M 4096M 15.2.0 204a01f9b0b6 6911ceebe5f2 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (30m) 23s ago 30m 51.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (6m) 23s ago 30m 61.0M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (28m) 80s ago 28m 41.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:06:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (28m) 23s ago 28m 40.8M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:06:28.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.873698+0000 mon.a (mon.0) 541 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.873750+0000 mon.a (mon.0) 542 : cluster [INF] osd.6 failed (root=default,host=smithi145) (connection refused reported by osd.1) 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.874027+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.874305+0000 mon.a (mon.0) 544 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.874505+0000 mon.a (mon.0) 545 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.874594+0000 mon.a (mon.0) 546 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.874808+0000 mon.a (mon.0) 547 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.874900+0000 mon.a (mon.0) 548 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.875249+0000 mon.a (mon.0) 549 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.875541+0000 mon.a (mon.0) 550 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.875650+0000 mon.a (mon.0) 551 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.875823+0000 mon.a (mon.0) 552 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.876003+0000 mon.a (mon.0) 553 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.876101+0000 mon.a (mon.0) 554 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:26.876405+0000 mon.a (mon.0) 555 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.043406+0000 mon.a (mon.0) 556 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.198984+0000 mgr.y (mgr.25069) 293 : audit [DBG] from='client.54465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.244515+0000 mon.a (mon.0) 557 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.274539+0000 mon.a (mon.0) 558 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.873698+0000 mon.a (mon.0) 541 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.873750+0000 mon.a (mon.0) 542 : cluster [INF] osd.6 failed (root=default,host=smithi145) (connection refused reported by osd.1) 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.874027+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.874305+0000 mon.a (mon.0) 544 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.874505+0000 mon.a (mon.0) 545 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.874594+0000 mon.a (mon.0) 546 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.874808+0000 mon.a (mon.0) 547 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.874900+0000 mon.a (mon.0) 548 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.875249+0000 mon.a (mon.0) 549 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.875541+0000 mon.a (mon.0) 550 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.875650+0000 mon.a (mon.0) 551 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.875823+0000 mon.a (mon.0) 552 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.876003+0000 mon.a (mon.0) 553 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.876101+0000 mon.a (mon.0) 554 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:26.876405+0000 mon.a (mon.0) 555 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.043406+0000 mon.a (mon.0) 556 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.198984+0000 mgr.y (mgr.25069) 293 : audit [DBG] from='client.54465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.244515+0000 mon.a (mon.0) 557 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.274539+0000 mon.a (mon.0) 558 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.274699+0000 mon.a (mon.0) 559 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.274836+0000 mon.a (mon.0) 560 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275024+0000 mon.a (mon.0) 561 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275233+0000 mon.a (mon.0) 562 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275311+0000 mon.a (mon.0) 563 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275461+0000 mon.a (mon.0) 564 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275538+0000 mon.a (mon.0) 565 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275690+0000 mon.a (mon.0) 566 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275762+0000 mon.a (mon.0) 567 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275909+0000 mon.a (mon.0) 568 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.275981+0000 mon.a (mon.0) 569 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.276139+0000 mon.a (mon.0) 570 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.276207+0000 mon.a (mon.0) 571 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.645441+0000 mon.a (mon.0) 572 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.847435+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.848022+0000 mon.b (mon.2) 360 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.848384+0000 mon.b (mon.2) 361 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.848691+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.848971+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.849304+0000 mon.b (mon.2) 364 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.274699+0000 mon.a (mon.0) 559 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.274836+0000 mon.a (mon.0) 560 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275024+0000 mon.a (mon.0) 561 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275233+0000 mon.a (mon.0) 562 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275311+0000 mon.a (mon.0) 563 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275461+0000 mon.a (mon.0) 564 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275538+0000 mon.a (mon.0) 565 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275690+0000 mon.a (mon.0) 566 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275762+0000 mon.a (mon.0) 567 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275909+0000 mon.a (mon.0) 568 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.275981+0000 mon.a (mon.0) 569 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.276139+0000 mon.a (mon.0) 570 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.276207+0000 mon.a (mon.0) 571 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.645441+0000 mon.a (mon.0) 572 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.847435+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.848022+0000 mon.b (mon.2) 360 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.848384+0000 mon.b (mon.2) 361 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.848691+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.848971+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.849304+0000 mon.b (mon.2) 364 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:06:28.268 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:06:28.268 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 11 2024-02-10T09:06:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:06:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:06:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.873698+0000 mon.a (mon.0) 541 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.873750+0000 mon.a (mon.0) 542 : cluster [INF] osd.6 failed (root=default,host=smithi145) (connection refused reported by osd.1) 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.874027+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.874305+0000 mon.a (mon.0) 544 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.874505+0000 mon.a (mon.0) 545 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.874594+0000 mon.a (mon.0) 546 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.874808+0000 mon.a (mon.0) 547 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.874900+0000 mon.a (mon.0) 548 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.875249+0000 mon.a (mon.0) 549 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.875541+0000 mon.a (mon.0) 550 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.875650+0000 mon.a (mon.0) 551 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.875823+0000 mon.a (mon.0) 552 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.876003+0000 mon.a (mon.0) 553 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.876101+0000 mon.a (mon.0) 554 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:26.876405+0000 mon.a (mon.0) 555 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.043406+0000 mon.a (mon.0) 556 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.198984+0000 mgr.y (mgr.25069) 293 : audit [DBG] from='client.54465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.244515+0000 mon.a (mon.0) 557 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.274539+0000 mon.a (mon.0) 558 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.274699+0000 mon.a (mon.0) 559 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.274836+0000 mon.a (mon.0) 560 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275024+0000 mon.a (mon.0) 561 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275233+0000 mon.a (mon.0) 562 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275311+0000 mon.a (mon.0) 563 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275461+0000 mon.a (mon.0) 564 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275538+0000 mon.a (mon.0) 565 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275690+0000 mon.a (mon.0) 566 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275762+0000 mon.a (mon.0) 567 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275909+0000 mon.a (mon.0) 568 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.275981+0000 mon.a (mon.0) 569 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.276139+0000 mon.a (mon.0) 570 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-10T09:06:28.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.276207+0000 mon.a (mon.0) 571 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.645441+0000 mon.a (mon.0) 572 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.847435+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.848022+0000 mon.b (mon.2) 360 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.848384+0000 mon.b (mon.2) 361 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.848691+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.848971+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.849304+0000 mon.b (mon.2) 364 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "6/8 daemons upgraded", 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:06:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:06:29.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.464176+0000 mgr.y (mgr.25069) 294 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.524921+0000 mgr.y (mgr.25069) 295 : audit [DBG] from='client.64414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.845348+0000 mgr.y (mgr.25069) 296 : audit [DBG] from='client.54477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.851218+0000 mon.b (mon.2) 365 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.851753+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.852144+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.852210+0000 mon.a (mon.0) 573 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.854870+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:27.861672+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:27.871294+0000 mon.b (mon.2) 369 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:28.268755+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/1174307684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:29.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.464176+0000 mgr.y (mgr.25069) 294 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.524921+0000 mgr.y (mgr.25069) 295 : audit [DBG] from='client.64414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.845348+0000 mgr.y (mgr.25069) 296 : audit [DBG] from='client.54477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.851218+0000 mon.b (mon.2) 365 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.851753+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.852144+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.852210+0000 mon.a (mon.0) 573 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.854870+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:27.861672+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:27.871294+0000 mon.b (mon.2) 369 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:28.268755+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/1174307684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:29.282 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:28 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.6.service: Succeeded. 2024-02-10T09:06:29.282 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:28 smithi145 systemd[1]: Stopped Ceph osd.6 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:06:29.282 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 systemd[1]: Starting Ceph osd.6 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:06:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.464176+0000 mgr.y (mgr.25069) 294 : cluster [DBG] pgmap v176: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.524921+0000 mgr.y (mgr.25069) 295 : audit [DBG] from='client.64414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.845348+0000 mgr.y (mgr.25069) 296 : audit [DBG] from='client.54477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.851218+0000 mon.b (mon.2) 365 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.851753+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.852144+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.852210+0000 mon.a (mon.0) 573 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.854870+0000 mon.b (mon.2) 368 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:27.861672+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:27.871294+0000 mon.b (mon.2) 369 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:06:29.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:28.268755+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.40:0/1174307684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:30.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:28.595795+0000 mgr.y (mgr.25069) 297 : audit [DBG] from='client.54489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:30.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:28.864630+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-10T09:06:30.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:28.595795+0000 mgr.y (mgr.25069) 297 : audit [DBG] from='client.54489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:30.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:29 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:28.864630+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-10T09:06:30.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:28.595795+0000 mgr.y (mgr.25069) 297 : audit [DBG] from='client.54489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:06:30.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:29 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:28.864630+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-10T09:06:30.195 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:06:30.195 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-10T09:06:30.195 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2024-02-10T09:06:30.195 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2024-02-10T09:06:30.196 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2024-02-10T09:06:30.196 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-10T09:06:30.196 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-10T09:06:30.196 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:29 smithi145 bash[68177]: --> ceph-volume lvm activate successful for osd ID: 6 2024-02-10T09:06:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:29.464694+0000 mgr.y (mgr.25069) 298 : cluster [DBG] pgmap v179: 129 pgs: 1 active+undersized+degraded, 8 peering, 10 stale+active+clean, 3 active+undersized, 107 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 9/609 objects degraded (1.478%) 2024-02-10T09:06:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:29.861957+0000 mon.a (mon.0) 576 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-10T09:06:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:29.862053+0000 mon.a (mon.0) 577 : cluster [WRN] Health check failed: Degraded data redundancy: 9/609 objects degraded (1.478%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:06:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:29.464694+0000 mgr.y (mgr.25069) 298 : cluster [DBG] pgmap v179: 129 pgs: 1 active+undersized+degraded, 8 peering, 10 stale+active+clean, 3 active+undersized, 107 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 9/609 objects degraded (1.478%) 2024-02-10T09:06:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:29.861957+0000 mon.a (mon.0) 576 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-10T09:06:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:29.862053+0000 mon.a (mon.0) 577 : cluster [WRN] Health check failed: Degraded data redundancy: 9/609 objects degraded (1.478%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:06:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:29.464694+0000 mgr.y (mgr.25069) 298 : cluster [DBG] pgmap v179: 129 pgs: 1 active+undersized+degraded, 8 peering, 10 stale+active+clean, 3 active+undersized, 107 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 9/609 objects degraded (1.478%) 2024-02-10T09:06:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:29.861957+0000 mon.a (mon.0) 576 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-10T09:06:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:29.862053+0000 mon.a (mon.0) 577 : cluster [WRN] Health check failed: Degraded data redundancy: 9/609 objects degraded (1.478%), 1 pg degraded (PG_DEGRADED) 2024-02-10T09:06:31.282 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:06:31.036+0000 7f28c0d32700 1 -- 172.21.15.145:0/2339287281 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e0365de680 con 0x55e0365a5000 2024-02-10T09:06:31.282 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:31 smithi145 bash[68421]: c4fd746dfb988d3e20fe9623dc1fb8b7e3726f8d7df73a936574e25749b8d6af 2024-02-10T09:06:31.283 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:31 smithi145 systemd[1]: Started Ceph osd.6 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:06:32.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:06:31.567+0000 7f28c87c0380 -1 Falling back to public interface 2024-02-10T09:06:32.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:31.154408+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:32.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:31.398595+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:32.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:31.401929+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:32.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:31.154408+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:32.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:31.398595+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:32.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:31.401929+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:31.154408+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:31.398595+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:32.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:31.401929+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:06:33.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:31.465235+0000 mgr.y (mgr.25069) 299 : cluster [DBG] pgmap v180: 129 pgs: 6 active+undersized+degraded, 8 peering, 2 stale+active+clean, 15 active+undersized, 98 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 34/609 objects degraded (5.583%) 2024-02-10T09:06:33.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:31.465235+0000 mgr.y (mgr.25069) 299 : cluster [DBG] pgmap v180: 129 pgs: 6 active+undersized+degraded, 8 peering, 2 stale+active+clean, 15 active+undersized, 98 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 34/609 objects degraded (5.583%) 2024-02-10T09:06:33.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:31.465235+0000 mgr.y (mgr.25069) 299 : cluster [DBG] pgmap v180: 129 pgs: 6 active+undersized+degraded, 8 peering, 2 stale+active+clean, 15 active+undersized, 98 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 34/609 objects degraded (5.583%) 2024-02-10T09:06:34.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:06:34.287+0000 7f28c87c0380 -1 osd.6 96 log_to_monitors {default=true} 2024-02-10T09:06:35.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:33.465899+0000 mgr.y (mgr.25069) 300 : cluster [DBG] pgmap v181: 129 pgs: 14 active+undersized+degraded, 8 peering, 21 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 61/609 objects degraded (10.016%) 2024-02-10T09:06:35.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:34.291259+0000 mon.b (mon.2) 371 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T09:06:35.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:34.291665+0000 mon.a (mon.0) 580 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T09:06:35.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:33.465899+0000 mgr.y (mgr.25069) 300 : cluster [DBG] pgmap v181: 129 pgs: 14 active+undersized+degraded, 8 peering, 21 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 61/609 objects degraded (10.016%) 2024-02-10T09:06:35.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:34.291259+0000 mon.b (mon.2) 371 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T09:06:35.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:34.291665+0000 mon.a (mon.0) 580 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T09:06:35.532 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:06:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:06:35.184+0000 7f28b74a2700 -1 osd.6 96 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:06:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:33.465899+0000 mgr.y (mgr.25069) 300 : cluster [DBG] pgmap v181: 129 pgs: 14 active+undersized+degraded, 8 peering, 21 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 61/609 objects degraded (10.016%) 2024-02-10T09:06:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:34.291259+0000 mon.b (mon.2) 371 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T09:06:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:34.291665+0000 mon.a (mon.0) 580 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-10T09:06:36.177 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:06:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:06:35.708+0000 7f95858b4700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:06:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.162973+0000 mon.a (mon.0) 581 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T09:06:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:35.163087+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-10T09:06:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.164520+0000 mon.b (mon.2) 372 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.168212+0000 mon.a (mon.0) 583 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.689744+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.695497+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.701170+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.704726+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.706204+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.707398+0000 mon.b (mon.2) 376 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.709149+0000 mon.b (mon.2) 377 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:36.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.162973+0000 mon.a (mon.0) 581 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:35.163087+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.164520+0000 mon.b (mon.2) 372 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.168212+0000 mon.a (mon.0) 583 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.689744+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.695497+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.701170+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.704726+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.706204+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.707398+0000 mon.b (mon.2) 376 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.709149+0000 mon.b (mon.2) 377 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.162973+0000 mon.a (mon.0) 581 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-10T09:06:36.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:35.163087+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.164520+0000 mon.b (mon.2) 372 : audit [INF] from='osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.168212+0000 mon.a (mon.0) 583 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.689744+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.695497+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.701170+0000 mon.b (mon.2) 373 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.704726+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.706204+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.707398+0000 mon.b (mon.2) 376 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:06:36.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.709149+0000 mon.b (mon.2) 377 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:35.466587+0000 mgr.y (mgr.25069) 301 : cluster [DBG] pgmap v183: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 73/609 objects degraded (11.987%) 2024-02-10T09:06:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:35.709453+0000 mgr.y (mgr.25069) 302 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:35.710266+0000 mgr.y (mgr.25069) 303 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:36.165258+0000 mon.a (mon.0) 586 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:36.165668+0000 mon.a (mon.0) 587 : cluster [WRN] Health check update: Degraded data redundancy: 73/609 objects degraded (11.987%), 18 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:36.165700+0000 mon.a (mon.0) 588 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:36.169648+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:36.169991+0000 mon.a (mon.0) 589 : cluster [INF] osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697] boot 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:36.170039+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-10T09:06:37.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:37.171875+0000 mon.a (mon.0) 591 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-10T09:06:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:35.466587+0000 mgr.y (mgr.25069) 301 : cluster [DBG] pgmap v183: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 73/609 objects degraded (11.987%) 2024-02-10T09:06:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:35.709453+0000 mgr.y (mgr.25069) 302 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:37.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:35.710266+0000 mgr.y (mgr.25069) 303 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:36.165258+0000 mon.a (mon.0) 586 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:36.165668+0000 mon.a (mon.0) 587 : cluster [WRN] Health check update: Degraded data redundancy: 73/609 objects degraded (11.987%), 18 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:36.165700+0000 mon.a (mon.0) 588 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:36.169648+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:36.169991+0000 mon.a (mon.0) 589 : cluster [INF] osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697] boot 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:36.170039+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:37.171875+0000 mon.a (mon.0) 591 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:35.466587+0000 mgr.y (mgr.25069) 301 : cluster [DBG] pgmap v183: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 73/609 objects degraded (11.987%) 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:35.709453+0000 mgr.y (mgr.25069) 302 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:37.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:35.710266+0000 mgr.y (mgr.25069) 303 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:36.165258+0000 mon.a (mon.0) 586 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:36.165668+0000 mon.a (mon.0) 587 : cluster [WRN] Health check update: Degraded data redundancy: 73/609 objects degraded (11.987%), 18 pgs degraded (PG_DEGRADED) 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:36.165700+0000 mon.a (mon.0) 588 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:36.169648+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:36.169991+0000 mon.a (mon.0) 589 : cluster [INF] osd.6 [v2:172.21.15.145:6816/314091697,v1:172.21.15.145:6817/314091697] boot 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:36.170039+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-10T09:06:37.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:37.171875+0000 mon.a (mon.0) 591 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-10T09:06:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:37.467020+0000 mgr.y (mgr.25069) 304 : cluster [DBG] pgmap v186: 129 pgs: 6 peering, 14 active+undersized+degraded, 23 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 58/609 objects degraded (9.524%) 2024-02-10T09:06:39.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:37.467020+0000 mgr.y (mgr.25069) 304 : cluster [DBG] pgmap v186: 129 pgs: 6 peering, 14 active+undersized+degraded, 23 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 58/609 objects degraded (9.524%) 2024-02-10T09:06:39.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:37.467020+0000 mgr.y (mgr.25069) 304 : cluster [DBG] pgmap v186: 129 pgs: 6 peering, 14 active+undersized+degraded, 23 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 58/609 objects degraded (9.524%) 2024-02-10T09:06:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:39.467689+0000 mgr.y (mgr.25069) 305 : cluster [DBG] pgmap v187: 129 pgs: 6 peering, 8 active+undersized+degraded, 14 active+undersized, 101 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:06:41.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:39.467689+0000 mgr.y (mgr.25069) 305 : cluster [DBG] pgmap v187: 129 pgs: 6 peering, 8 active+undersized+degraded, 14 active+undersized, 101 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:06:41.675 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:39.467689+0000 mgr.y (mgr.25069) 305 : cluster [DBG] pgmap v187: 129 pgs: 6 peering, 8 active+undersized+degraded, 14 active+undersized, 101 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 28/609 objects degraded (4.598%) 2024-02-10T09:06:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:41.468316+0000 mgr.y (mgr.25069) 306 : cluster [DBG] pgmap v188: 129 pgs: 6 peering, 123 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:41.754267+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:42.189771+0000 mon.a (mon.0) 593 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/609 objects degraded (4.598%), 8 pgs degraded) 2024-02-10T09:06:43.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:42.189801+0000 mon.a (mon.0) 594 : cluster [INF] Cluster is now healthy 2024-02-10T09:06:43.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:41.468316+0000 mgr.y (mgr.25069) 306 : cluster [DBG] pgmap v188: 129 pgs: 6 peering, 123 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:41.754267+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:42.189771+0000 mon.a (mon.0) 593 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/609 objects degraded (4.598%), 8 pgs degraded) 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:42.189801+0000 mon.a (mon.0) 594 : cluster [INF] Cluster is now healthy 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:41.468316+0000 mgr.y (mgr.25069) 306 : cluster [DBG] pgmap v188: 129 pgs: 6 peering, 123 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:41.754267+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:42.189771+0000 mon.a (mon.0) 593 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/609 objects degraded (4.598%), 8 pgs degraded) 2024-02-10T09:06:43.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:42.189801+0000 mon.a (mon.0) 594 : cluster [INF] Cluster is now healthy 2024-02-10T09:06:45.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:43.468940+0000 mgr.y (mgr.25069) 307 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:45.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:43.468940+0000 mgr.y (mgr.25069) 307 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:43.468940+0000 mgr.y (mgr.25069) 307 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:47.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:45.469487+0000 mgr.y (mgr.25069) 308 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:47.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:45.469487+0000 mgr.y (mgr.25069) 308 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:47.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:45.469487+0000 mgr.y (mgr.25069) 308 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:49.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:47.470031+0000 mgr.y (mgr.25069) 309 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:47.470031+0000 mgr.y (mgr.25069) 309 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:47.470031+0000 mgr.y (mgr.25069) 309 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:49.470762+0000 mgr.y (mgr.25069) 310 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:51.142 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:50.716687+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:51.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:49.470762+0000 mgr.y (mgr.25069) 310 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:51.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:50.716687+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:49.470762+0000 mgr.y (mgr.25069) 310 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:50.716687+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:52.076 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:50.716977+0000 mgr.y (mgr.25069) 311 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:52.076 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:50.718566+0000 mgr.y (mgr.25069) 312 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-02-10T09:06:52.076 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:51.770109+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:52.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:50.716977+0000 mgr.y (mgr.25069) 311 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:52.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:50.718566+0000 mgr.y (mgr.25069) 312 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-02-10T09:06:52.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:51.770109+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:50.716977+0000 mgr.y (mgr.25069) 311 : audit [DBG] from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-10T09:06:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:50.718566+0000 mgr.y (mgr.25069) 312 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-02-10T09:06:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:51.770109+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:53.398 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:51.471353+0000 mgr.y (mgr.25069) 313 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:53.399 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:52.093432+0000 mgr.y (mgr.25069) 314 : cephadm [INF] Upgrade: Updating osd.7 2024-02-10T09:06:53.399 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:52.098331+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:53.399 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:52.099274+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T09:06:53.399 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:52.099933+0000 mon.b (mon.2) 381 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:06:53.399 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:06:52.101167+0000 mgr.y (mgr.25069) 315 : cephadm [INF] Deploying daemon osd.7 on smithi145 2024-02-10T09:06:53.399 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:52.101612+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-10T09:06:53.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:51.471353+0000 mgr.y (mgr.25069) 313 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:53.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:52.093432+0000 mgr.y (mgr.25069) 314 : cephadm [INF] Upgrade: Updating osd.7 2024-02-10T09:06:53.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:52.098331+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:52.099274+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:52.099933+0000 mon.b (mon.2) 381 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:06:52.101167+0000 mgr.y (mgr.25069) 315 : cephadm [INF] Deploying daemon osd.7 on smithi145 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:52.101612+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:51.471353+0000 mgr.y (mgr.25069) 313 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:52.093432+0000 mgr.y (mgr.25069) 314 : cephadm [INF] Upgrade: Updating osd.7 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:52.098331+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:52.099274+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:52.099933+0000 mon.b (mon.2) 381 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:06:52.101167+0000 mgr.y (mgr.25069) 315 : cephadm [INF] Deploying daemon osd.7 on smithi145 2024-02-10T09:06:53.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:52.101612+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-10T09:06:55.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:53.471889+0000 mgr.y (mgr.25069) 316 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:55.258 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:55 smithi145 systemd[1]: Stopping Ceph osd.7 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:06:55.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:53.471889+0000 mgr.y (mgr.25069) 316 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:55.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:53.471889+0000 mgr.y (mgr.25069) 316 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:55.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:55 smithi145 bash[42892]: debug 2024-02-10T09:06:55.256+0000 7f718b352700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-10T09:06:55.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:55 smithi145 bash[42892]: debug 2024-02-10T09:06:55.256+0000 7f718b352700 -1 osd.7 101 *** Got signal Terminated *** 2024-02-10T09:06:55.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:55 smithi145 bash[42892]: debug 2024-02-10T09:06:55.256+0000 7f718b352700 -1 osd.7 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:06:55.916 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:55 smithi145 bash[69537]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.7 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.313397+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.313445+0000 mon.a (mon.0) 598 : cluster [INF] osd.7 failed (root=default,host=smithi145) (connection refused reported by osd.2) 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.513560+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.513666+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.513934+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.514132+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.514293+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.514473+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.514630+0000 mon.a (mon.0) 605 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.514813+0000 mon.a (mon.0) 606 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.514957+0000 mon.a (mon.0) 607 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.515152+0000 mon.a (mon.0) 608 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.515313+0000 mon.a (mon.0) 609 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.515492+0000 mon.a (mon.0) 610 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.515634+0000 mon.a (mon.0) 611 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.515818+0000 mon.a (mon.0) 612 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.914526+0000 mon.a (mon.0) 613 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.914744+0000 mon.a (mon.0) 614 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.914917+0000 mon.a (mon.0) 615 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.915192+0000 mon.a (mon.0) 616 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.313397+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.313445+0000 mon.a (mon.0) 598 : cluster [INF] osd.7 failed (root=default,host=smithi145) (connection refused reported by osd.2) 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.513560+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.513666+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.513934+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.514132+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.514293+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.514473+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.514630+0000 mon.a (mon.0) 605 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.514813+0000 mon.a (mon.0) 606 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.514957+0000 mon.a (mon.0) 607 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.515152+0000 mon.a (mon.0) 608 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.515313+0000 mon.a (mon.0) 609 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.515492+0000 mon.a (mon.0) 610 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.515634+0000 mon.a (mon.0) 611 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.515818+0000 mon.a (mon.0) 612 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.914526+0000 mon.a (mon.0) 613 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.914744+0000 mon.a (mon.0) 614 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.914917+0000 mon.a (mon.0) 615 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.915192+0000 mon.a (mon.0) 616 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.915311+0000 mon.a (mon.0) 617 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.915511+0000 mon.a (mon.0) 618 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.915622+0000 mon.a (mon.0) 619 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.915820+0000 mon.a (mon.0) 620 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.915937+0000 mon.a (mon.0) 621 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.916128+0000 mon.a (mon.0) 622 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.916246+0000 mon.a (mon.0) 623 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.916434+0000 mon.a (mon.0) 624 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.916553+0000 mon.a (mon.0) 625 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.916737+0000 mon.a (mon.0) 626 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.915311+0000 mon.a (mon.0) 617 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.915511+0000 mon.a (mon.0) 618 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.915622+0000 mon.a (mon.0) 619 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.915820+0000 mon.a (mon.0) 620 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.915937+0000 mon.a (mon.0) 621 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.916128+0000 mon.a (mon.0) 622 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.916246+0000 mon.a (mon.0) 623 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.430 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.916434+0000 mon.a (mon.0) 624 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.916553+0000 mon.a (mon.0) 625 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.431 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.916737+0000 mon.a (mon.0) 626 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.313397+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.313445+0000 mon.a (mon.0) 598 : cluster [INF] osd.7 failed (root=default,host=smithi145) (connection refused reported by osd.2) 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.513560+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.513666+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.513934+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.514132+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.514293+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.514473+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.514630+0000 mon.a (mon.0) 605 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.514813+0000 mon.a (mon.0) 606 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.514957+0000 mon.a (mon.0) 607 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.515152+0000 mon.a (mon.0) 608 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.515313+0000 mon.a (mon.0) 609 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.515492+0000 mon.a (mon.0) 610 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.515634+0000 mon.a (mon.0) 611 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.515818+0000 mon.a (mon.0) 612 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.914526+0000 mon.a (mon.0) 613 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.914744+0000 mon.a (mon.0) 614 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.914917+0000 mon.a (mon.0) 615 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.915192+0000 mon.a (mon.0) 616 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.915311+0000 mon.a (mon.0) 617 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.915511+0000 mon.a (mon.0) 618 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.915622+0000 mon.a (mon.0) 619 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.915820+0000 mon.a (mon.0) 620 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.915937+0000 mon.a (mon.0) 621 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:56.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.916128+0000 mon.a (mon.0) 622 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-10T09:06:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.916246+0000 mon.a (mon.0) 623 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-10T09:06:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.916434+0000 mon.a (mon.0) 624 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-10T09:06:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.916553+0000 mon.a (mon.0) 625 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-10T09:06:56.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.916737+0000 mon.a (mon.0) 626 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-10T09:06:57.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:55.472703+0000 mgr.y (mgr.25069) 317 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:57.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:56.101521+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:06:57.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:56.101547+0000 mon.a (mon.0) 628 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED) 2024-02-10T09:06:57.388 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:56.111188+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-10T09:06:57.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:55.472703+0000 mgr.y (mgr.25069) 317 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:57.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:56.101521+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:06:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:56.101547+0000 mon.a (mon.0) 628 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED) 2024-02-10T09:06:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:56.111188+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-10T09:06:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:55.472703+0000 mgr.y (mgr.25069) 317 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:56.101521+0000 mon.a (mon.0) 627 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-10T09:06:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:56.101547+0000 mon.a (mon.0) 628 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED) 2024-02-10T09:06:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:56.111188+0000 mon.a (mon.0) 629 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-10T09:06:58.032 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:57 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.7.service: Succeeded. 2024-02-10T09:06:58.032 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:57 smithi145 systemd[1]: Stopped Ceph osd.7 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:06:58.032 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:57 smithi145 systemd[1]: Starting Ceph osd.7 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:06:58.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:57.117656+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-10T09:06:58.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:57.117656+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-10T09:06:58.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:57.117656+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-10T09:06:58.948 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:06:59.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-10T09:06:59.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-10T09:06:59.004 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-02-10T09:06:59.004 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-02-10T09:06:59.004 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-02-10T09:06:59.004 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-10T09:06:59.004 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-10T09:06:59.004 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:58 smithi145 bash[69836]: --> ceph-volume lvm activate successful for osd ID: 7 2024-02-10T09:06:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:06:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:57.473240+0000 mgr.y (mgr.25069) 318 : cluster [DBG] pgmap v198: 129 pgs: 4 peering, 16 stale+active+clean, 109 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:59.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:06:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:57.473240+0000 mgr.y (mgr.25069) 318 : cluster [DBG] pgmap v198: 129 pgs: 4 peering, 16 stale+active+clean, 109 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:59.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:06:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:57.473240+0000 mgr.y (mgr.25069) 318 : cluster [DBG] pgmap v198: 129 pgs: 4 peering, 16 stale+active+clean, 109 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-10T09:06:59.605 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:06:59.605 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (7m) 112s ago 30m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:06:59.605 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (6m) 23s ago 30m 57.4M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:06:59.605 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (8m) 23s ago 34m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (17m) 112s ago 35m 427M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (5m) 112s ago 36m 72.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (6m) 23s ago 34m 69.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (5m) 112s ago 34m 63.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (7m) 112s ago 30m 13.4M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (7m) 23s ago 30m 23.9M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (4m) 112s ago 33m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:06:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (3m) 112s ago 33m 40.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (2m) 112s ago 33m 41.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (116s) 112s ago 32m 15.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (88s) 23s ago 32m 41.2M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (60s) 23s ago 32m 39.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (28s) 23s ago 31m 14.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc c4fd746dfb98 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (31m) 23s ago 31m 52.9M 4096M 15.2.0 204a01f9b0b6 0bad5adb0a7c 2024-02-10T09:06:59.607 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (7m) 23s ago 30m 65.3M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:06:59.608 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (29m) 112s ago 29m 41.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:06:59.608 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (28m) 23s ago 28m 41.0M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:07:00.000 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:07:00.000 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:07:00.000 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:07:00.000 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:00.000 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 7 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 12 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:07:00.001 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:07:00.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:59 smithi145 bash[70071]: 660a4a57cca9f27d55dddb291f4b6b2a6fbb82d2a56e7378c6b9b61b35793564 2024-02-10T09:07:00.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:06:59 smithi145 systemd[1]: Started Ceph osd.7 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:07:00.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:58.937483+0000 mgr.y (mgr.25069) 319 : audit [DBG] from='client.64438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.594921+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.595417+0000 mon.b (mon.2) 384 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.595702+0000 mon.b (mon.2) 385 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.596000+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.596273+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.596550+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.598247+0000 mon.b (mon.2) 389 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.598570+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.598847+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.599125+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.599409+0000 mon.b (mon.2) 393 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.944486+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.946451+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:00.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:00.000474+0000 mon.a (mon.0) 632 : audit [DBG] from='client.54513 172.21.15.40:0/3027046939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:00.329 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "7/8 daemons upgraded", 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading osd daemons", 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:07:00.330 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:07:00.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:58.937483+0000 mgr.y (mgr.25069) 319 : audit [DBG] from='client.64438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:00.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.594921+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.595417+0000 mon.b (mon.2) 384 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.595702+0000 mon.b (mon.2) 385 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.596000+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.596273+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.596550+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.598247+0000 mon.b (mon.2) 389 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.598570+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.598847+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.599125+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.599409+0000 mon.b (mon.2) 393 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.944486+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.946451+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:00.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:00.000474+0000 mon.a (mon.0) 632 : audit [DBG] from='client.54513 172.21.15.40:0/3027046939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:58.937483+0000 mgr.y (mgr.25069) 319 : audit [DBG] from='client.64438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.594921+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.595417+0000 mon.b (mon.2) 384 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.595702+0000 mon.b (mon.2) 385 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.596000+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.596273+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.596550+0000 mon.b (mon.2) 388 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.598247+0000 mon.b (mon.2) 389 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.598570+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.598847+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.599125+0000 mon.b (mon.2) 392 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.599409+0000 mon.b (mon.2) 393 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.944486+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:00.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.946451+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:00.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:00.000474+0000 mon.a (mon.0) 632 : audit [DBG] from='client.54513 172.21.15.40:0/3027046939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:00.782 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:07:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:07:00.343+0000 7f5353c1f380 -1 Falling back to public interface 2024-02-10T09:07:01.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.268917+0000 mgr.y (mgr.25069) 320 : audit [DBG] from='client.54501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:01.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:06:59.473961+0000 mgr.y (mgr.25069) 321 : cluster [DBG] pgmap v199: 129 pgs: 12 active+undersized+degraded, 4 peering, 12 stale+active+clean, 12 active+undersized, 89 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 37/609 objects degraded (6.076%) 2024-02-10T09:07:01.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:06:59.592956+0000 mgr.y (mgr.25069) 322 : audit [DBG] from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:01.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:00.121178+0000 mon.a (mon.0) 633 : cluster [WRN] Health check failed: Degraded data redundancy: 37/609 objects degraded (6.076%), 12 pgs degraded (PG_DEGRADED) 2024-02-10T09:07:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.268917+0000 mgr.y (mgr.25069) 320 : audit [DBG] from='client.54501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:06:59.473961+0000 mgr.y (mgr.25069) 321 : cluster [DBG] pgmap v199: 129 pgs: 12 active+undersized+degraded, 4 peering, 12 stale+active+clean, 12 active+undersized, 89 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 37/609 objects degraded (6.076%) 2024-02-10T09:07:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:06:59.592956+0000 mgr.y (mgr.25069) 322 : audit [DBG] from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:00.121178+0000 mon.a (mon.0) 633 : cluster [WRN] Health check failed: Degraded data redundancy: 37/609 objects degraded (6.076%), 12 pgs degraded (PG_DEGRADED) 2024-02-10T09:07:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.268917+0000 mgr.y (mgr.25069) 320 : audit [DBG] from='client.54501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:06:59.473961+0000 mgr.y (mgr.25069) 321 : cluster [DBG] pgmap v199: 129 pgs: 12 active+undersized+degraded, 4 peering, 12 stale+active+clean, 12 active+undersized, 89 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 37/609 objects degraded (6.076%) 2024-02-10T09:07:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:06:59.592956+0000 mgr.y (mgr.25069) 322 : audit [DBG] from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:01.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:00.121178+0000 mon.a (mon.0) 633 : cluster [WRN] Health check failed: Degraded data redundancy: 37/609 objects degraded (6.076%), 12 pgs degraded (PG_DEGRADED) 2024-02-10T09:07:02.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:00.329701+0000 mgr.y (mgr.25069) 323 : audit [DBG] from='client.64465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:02.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:00.329701+0000 mgr.y (mgr.25069) 323 : audit [DBG] from='client.64465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:02.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:00.329701+0000 mgr.y (mgr.25069) 323 : audit [DBG] from='client.64465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:03.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:07:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:07:03.092+0000 7f5353c1f380 -1 osd.7 101 log_to_monitors {default=true} 2024-02-10T09:07:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:01.474659+0000 mgr.y (mgr.25069) 324 : cluster [DBG] pgmap v200: 129 pgs: 26 active+undersized+degraded, 4 peering, 27 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:07:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:03.096466+0000 mon.b (mon.2) 395 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T09:07:03.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:03.096887+0000 mon.a (mon.0) 634 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T09:07:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:01.474659+0000 mgr.y (mgr.25069) 324 : cluster [DBG] pgmap v200: 129 pgs: 26 active+undersized+degraded, 4 peering, 27 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:07:03.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:03.096466+0000 mon.b (mon.2) 395 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T09:07:03.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:03.096887+0000 mon.a (mon.0) 634 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T09:07:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:01.474659+0000 mgr.y (mgr.25069) 324 : cluster [DBG] pgmap v200: 129 pgs: 26 active+undersized+degraded, 4 peering, 27 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 82/609 objects degraded (13.465%) 2024-02-10T09:07:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:03.096466+0000 mon.b (mon.2) 395 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T09:07:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:03.096887+0000 mon.a (mon.0) 634 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-10T09:07:04.137 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:07:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:07:03.835+0000 7f5344905700 -1 osd.7 101 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:03.475421+0000 mgr.y (mgr.25069) 325 : cluster [DBG] pgmap v201: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 83/609 objects degraded (13.629%) 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:03.815094+0000 mon.a (mon.0) 635 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:03.815206+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:03.815947+0000 mon.b (mon.2) 396 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:03.816390+0000 mon.a (mon.0) 637 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.372592+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.380159+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.385005+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.387776+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.389042+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.390111+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.391876+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.397750+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.398604+0000 mon.b (mon.2) 402 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.398867+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:03.475421+0000 mgr.y (mgr.25069) 325 : cluster [DBG] pgmap v201: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 83/609 objects degraded (13.629%) 2024-02-10T09:07:05.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:03.815094+0000 mon.a (mon.0) 635 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:03.815206+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:03.815947+0000 mon.b (mon.2) 396 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:03.816390+0000 mon.a (mon.0) 637 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.372592+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.380159+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.385005+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.387776+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.178 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.389042+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.390111+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.391876+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.397750+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.398604+0000 mon.b (mon.2) 402 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-10T09:07:05.179 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.398867+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-10T09:07:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.404990+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-10T09:07:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.405904+0000 mon.b (mon.2) 403 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-10T09:07:05.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.406189+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.411423+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.412214+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.412525+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.417825+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.418623+0000 mon.b (mon.2) 405 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.418921+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-10T09:07:05.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.424142+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-10T09:07:05.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.425145+0000 mon.b (mon.2) 406 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-10T09:07:05.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.425429+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-10T09:07:05.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.430844+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-10T09:07:05.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.431807+0000 mon.b (mon.2) 407 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-10T09:07:05.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.432102+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-10T09:07:05.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.438240+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.439231+0000 mon.b (mon.2) 408 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.439628+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.445844+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.446664+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.447236+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.453786+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-02-10T09:07:05.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.455285+0000 mon.b (mon.2) 410 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-10T09:07:05.184 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.455584+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-10T09:07:05.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.404990+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-10T09:07:05.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.405904+0000 mon.b (mon.2) 403 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-10T09:07:05.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.406189+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-10T09:07:05.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.411423+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-10T09:07:05.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.412214+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-10T09:07:05.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.412525+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-10T09:07:05.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.417825+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-10T09:07:05.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.418623+0000 mon.b (mon.2) 405 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-10T09:07:05.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.418921+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-10T09:07:05.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.424142+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-10T09:07:05.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.425145+0000 mon.b (mon.2) 406 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-10T09:07:05.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.425429+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-10T09:07:05.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.430844+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-10T09:07:05.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.431807+0000 mon.b (mon.2) 407 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-10T09:07:05.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.432102+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-10T09:07:05.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.438240+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-10T09:07:05.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.439231+0000 mon.b (mon.2) 408 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-10T09:07:05.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.439628+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-10T09:07:05.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.445844+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-02-10T09:07:05.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.446664+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-10T09:07:05.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.447236+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-10T09:07:05.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.453786+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-02-10T09:07:05.191 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.455285+0000 mon.b (mon.2) 410 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-10T09:07:05.192 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.455584+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:03.475421+0000 mgr.y (mgr.25069) 325 : cluster [DBG] pgmap v201: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 83/609 objects degraded (13.629%) 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:03.815094+0000 mon.a (mon.0) 635 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:03.815206+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:03.815947+0000 mon.b (mon.2) 396 : audit [INF] from='osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:03.816390+0000 mon.a (mon.0) 637 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.372592+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.380159+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.385005+0000 mon.b (mon.2) 397 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.387776+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.389042+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.390111+0000 mon.b (mon.2) 400 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.391876+0000 mon.b (mon.2) 401 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.397750+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.398604+0000 mon.b (mon.2) 402 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.398867+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.404990+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.405904+0000 mon.b (mon.2) 403 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.406189+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.411423+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.412214+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.412525+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.417825+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.418623+0000 mon.b (mon.2) 405 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.418921+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-10T09:07:05.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.424142+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.425145+0000 mon.b (mon.2) 406 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.425429+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.430844+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.431807+0000 mon.b (mon.2) 407 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.432102+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.438240+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.439231+0000 mon.b (mon.2) 408 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.439628+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.445844+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.446664+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-10T09:07:05.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.447236+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-10T09:07:05.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.453786+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-02-10T09:07:05.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.455285+0000 mon.b (mon.2) 410 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-10T09:07:05.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.455584+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.392482+0000 mgr.y (mgr.25069) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.455055+0000 mgr.y (mgr.25069) 327 : cephadm [INF] Upgrade: Setting require_osd_release to 16 pacific 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:04.812179+0000 mon.a (mon.0) 658 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:04.812202+0000 mon.a (mon.0) 659 : cluster [INF] Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running pacific or later but require_osd_release < pacific) 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:04.818101+0000 mon.a (mon.0) 660 : cluster [INF] osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358] boot 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.818168+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "pacific"}]': finished 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:04.818228+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.818649+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.823568+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.842513+0000 mgr.y (mgr.25069) 328 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:07:06.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.850685+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.854452+0000 mon.b (mon.2) 413 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.855110+0000 mgr.y (mgr.25069) 329 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.858930+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.860052+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.861034+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.861573+0000 mgr.y (mgr.25069) 330 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.865254+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.392482+0000 mgr.y (mgr.25069) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.455055+0000 mgr.y (mgr.25069) 327 : cephadm [INF] Upgrade: Setting require_osd_release to 16 pacific 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:04.812179+0000 mon.a (mon.0) 658 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:04.812202+0000 mon.a (mon.0) 659 : cluster [INF] Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running pacific or later but require_osd_release < pacific) 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:04.818101+0000 mon.a (mon.0) 660 : cluster [INF] osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358] boot 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.818168+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "pacific"}]': finished 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:04.818228+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.818649+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.823568+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.842513+0000 mgr.y (mgr.25069) 328 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.850685+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.854452+0000 mon.b (mon.2) 413 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.855110+0000 mgr.y (mgr.25069) 329 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.858930+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.178 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.860052+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.861034+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.861573+0000 mgr.y (mgr.25069) 330 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.865254+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.866287+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.866877+0000 mgr.y (mgr.25069) 331 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.871138+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.872845+0000 mon.b (mon.2) 417 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.874082+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.875444+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.876860+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.877577+0000 mgr.y (mgr.25069) 332 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.879054+0000 mon.b (mon.2) 421 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.879285+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.883234+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.884062+0000 mon.b (mon.2) 422 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.179 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.884332+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.887682+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.888462+0000 mon.b (mon.2) 423 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.888706+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.866287+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.866877+0000 mgr.y (mgr.25069) 331 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.871138+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.872845+0000 mon.b (mon.2) 417 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.874082+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.875444+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.876860+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.877577+0000 mgr.y (mgr.25069) 332 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.879054+0000 mon.b (mon.2) 421 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.879285+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.883234+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.884062+0000 mon.b (mon.2) 422 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.884332+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.887682+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.888462+0000 mon.b (mon.2) 423 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.888706+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:07:06.181 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.891838+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.894401+0000 mon.b (mon.2) 424 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.894661+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.897675+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.900584+0000 mon.b (mon.2) 425 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.900958+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.904140+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.906978+0000 mon.b (mon.2) 426 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.907263+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.907875+0000 mon.b (mon.2) 427 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.908108+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.911631+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.914411+0000 mon.b (mon.2) 428 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.914769+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.915474+0000 mon.b (mon.2) 429 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:07:06.182 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.915696+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.919017+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.921570+0000 mon.b (mon.2) 430 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.921823+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.924992+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.927722+0000 mon.b (mon.2) 431 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.928022+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.928912+0000 mon.b (mon.2) 432 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.929298+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.929980+0000 mon.b (mon.2) 433 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.930211+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.930807+0000 mon.b (mon.2) 434 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.931032+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.183 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.931648+0000 mon.b (mon.2) 435 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.891838+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.894401+0000 mon.b (mon.2) 424 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.894661+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.897675+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.900584+0000 mon.b (mon.2) 425 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.900958+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.904140+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.906978+0000 mon.b (mon.2) 426 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.907263+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.907875+0000 mon.b (mon.2) 427 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.908108+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.911631+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.914411+0000 mon.b (mon.2) 428 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.184 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.914769+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.931875+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.935040+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:04.937457+0000 mgr.y (mgr.25069) 333 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.937859+0000 mon.b (mon.2) 436 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.938167+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.941030+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.945623+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.185 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:04.953433+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.915474+0000 mon.b (mon.2) 429 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.915696+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.919017+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.921570+0000 mon.b (mon.2) 430 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.921823+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.924992+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.927722+0000 mon.b (mon.2) 431 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.928022+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.928912+0000 mon.b (mon.2) 432 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.929298+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.186 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.929980+0000 mon.b (mon.2) 433 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.930211+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.930807+0000 mon.b (mon.2) 434 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.931032+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.931648+0000 mon.b (mon.2) 435 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.931875+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.935040+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:04.937457+0000 mgr.y (mgr.25069) 333 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.937859+0000 mon.b (mon.2) 436 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.938167+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.941030+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.945623+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:05 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:04.953433+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.392482+0000 mgr.y (mgr.25069) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.455055+0000 mgr.y (mgr.25069) 327 : cephadm [INF] Upgrade: Setting require_osd_release to 16 pacific 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:04.812179+0000 mon.a (mon.0) 658 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:04.812202+0000 mon.a (mon.0) 659 : cluster [INF] Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running pacific or later but require_osd_release < pacific) 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:04.818101+0000 mon.a (mon.0) 660 : cluster [INF] osd.7 [v2:172.21.15.145:6824/1221133358,v1:172.21.15.145:6825/1221133358] boot 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.818168+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "pacific"}]': finished 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:04.818228+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.818649+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.823568+0000 mon.b (mon.2) 412 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.842513+0000 mgr.y (mgr.25069) 328 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.850685+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.854452+0000 mon.b (mon.2) 413 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.855110+0000 mgr.y (mgr.25069) 329 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.858930+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.860052+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.861034+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.861573+0000 mgr.y (mgr.25069) 330 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.865254+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.866287+0000 mon.b (mon.2) 416 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.866877+0000 mgr.y (mgr.25069) 331 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.871138+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.872845+0000 mon.b (mon.2) 417 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.874082+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.875444+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.876860+0000 mon.b (mon.2) 420 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.877577+0000 mgr.y (mgr.25069) 332 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.879054+0000 mon.b (mon.2) 421 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.879285+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.883234+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:07:06.286 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.884062+0000 mon.b (mon.2) 422 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.884332+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.887682+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.888462+0000 mon.b (mon.2) 423 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.888706+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.891838+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.894401+0000 mon.b (mon.2) 424 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.894661+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.897675+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.900584+0000 mon.b (mon.2) 425 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.900958+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.904140+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.906978+0000 mon.b (mon.2) 426 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.907263+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.907875+0000 mon.b (mon.2) 427 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:07:06.287 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.908108+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.911631+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.914411+0000 mon.b (mon.2) 428 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.914769+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.915474+0000 mon.b (mon.2) 429 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.915696+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.919017+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.921570+0000 mon.b (mon.2) 430 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.921823+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.924992+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.927722+0000 mon.b (mon.2) 431 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.928022+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.928912+0000 mon.b (mon.2) 432 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.929298+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.288 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.929980+0000 mon.b (mon.2) 433 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.930211+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.930807+0000 mon.b (mon.2) 434 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.931032+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.931648+0000 mon.b (mon.2) 435 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.931875+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.935040+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:04.937457+0000 mgr.y (mgr.25069) 333 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.937859+0000 mon.b (mon.2) 436 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.938167+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.941030+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.945623+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:06.289 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:04.953433+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:05.476230+0000 mgr.y (mgr.25069) 334 : cluster [DBG] pgmap v204: 129 pgs: 10 peering, 24 active+undersized+degraded, 23 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 71/609 objects degraded (11.658%) 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:05.820553+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:05.952137+0000 mon.a (mon.0) 696 : cluster [WRN] Health check update: Degraded data redundancy: 71/609 objects degraded (11.658%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:06.783738+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:05.476230+0000 mgr.y (mgr.25069) 334 : cluster [DBG] pgmap v204: 129 pgs: 10 peering, 24 active+undersized+degraded, 23 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 71/609 objects degraded (11.658%) 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:05.820553+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:05.952137+0000 mon.a (mon.0) 696 : cluster [WRN] Health check update: Degraded data redundancy: 71/609 objects degraded (11.658%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T09:07:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:06.783738+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:05.476230+0000 mgr.y (mgr.25069) 334 : cluster [DBG] pgmap v204: 129 pgs: 10 peering, 24 active+undersized+degraded, 23 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 71/609 objects degraded (11.658%) 2024-02-10T09:07:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:05.820553+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-10T09:07:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:05.952137+0000 mon.a (mon.0) 696 : cluster [WRN] Health check update: Degraded data redundancy: 71/609 objects degraded (11.658%), 24 pgs degraded (PG_DEGRADED) 2024-02-10T09:07:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:06.783738+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:09.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:07.476781+0000 mgr.y (mgr.25069) 335 : cluster [DBG] pgmap v206: 129 pgs: 10 peering, 19 active+undersized+degraded, 18 active+undersized, 82 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 62/609 objects degraded (10.181%) 2024-02-10T09:07:09.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:07.476781+0000 mgr.y (mgr.25069) 335 : cluster [DBG] pgmap v206: 129 pgs: 10 peering, 19 active+undersized+degraded, 18 active+undersized, 82 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 62/609 objects degraded (10.181%) 2024-02-10T09:07:09.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:07.476781+0000 mgr.y (mgr.25069) 335 : cluster [DBG] pgmap v206: 129 pgs: 10 peering, 19 active+undersized+degraded, 18 active+undersized, 82 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 62/609 objects degraded (10.181%) 2024-02-10T09:07:10.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:09.836717+0000 mon.a (mon.0) 698 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/609 objects degraded (10.181%), 19 pgs degraded) 2024-02-10T09:07:10.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:09.836747+0000 mon.a (mon.0) 699 : cluster [INF] Cluster is now healthy 2024-02-10T09:07:10.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:09.836717+0000 mon.a (mon.0) 698 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/609 objects degraded (10.181%), 19 pgs degraded) 2024-02-10T09:07:10.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:09 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:09.836747+0000 mon.a (mon.0) 699 : cluster [INF] Cluster is now healthy 2024-02-10T09:07:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:09.836717+0000 mon.a (mon.0) 698 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/609 objects degraded (10.181%), 19 pgs degraded) 2024-02-10T09:07:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:09.836747+0000 mon.a (mon.0) 699 : cluster [INF] Cluster is now healthy 2024-02-10T09:07:11.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:09.477408+0000 mgr.y (mgr.25069) 336 : cluster [DBG] pgmap v207: 129 pgs: 10 peering, 119 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:11.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:09.477408+0000 mgr.y (mgr.25069) 336 : cluster [DBG] pgmap v207: 129 pgs: 10 peering, 119 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:09.477408+0000 mgr.y (mgr.25069) 336 : cluster [DBG] pgmap v207: 129 pgs: 10 peering, 119 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:13.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:11.478140+0000 mgr.y (mgr.25069) 337 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:11.478140+0000 mgr.y (mgr.25069) 337 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:11.478140+0000 mgr.y (mgr.25069) 337 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:15.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:13.478599+0000 mgr.y (mgr.25069) 338 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:15.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:13.478599+0000 mgr.y (mgr.25069) 338 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:13.478599+0000 mgr.y (mgr.25069) 338 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:17.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:15.479389+0000 mgr.y (mgr.25069) 339 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:17.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:16.796539+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:17.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:15.479389+0000 mgr.y (mgr.25069) 339 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:17.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:16.796539+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:15.479389+0000 mgr.y (mgr.25069) 339 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:16.796539+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:17.479931+0000 mgr.y (mgr.25069) 340 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:19.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:17.479931+0000 mgr.y (mgr.25069) 340 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:17.479931+0000 mgr.y (mgr.25069) 340 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:19.480503+0000 mgr.y (mgr.25069) 341 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:19.480503+0000 mgr.y (mgr.25069) 341 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:19.480503+0000 mgr.y (mgr.25069) 341 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:21.481170+0000 mgr.y (mgr.25069) 342 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:23.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:21.481170+0000 mgr.y (mgr.25069) 342 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:21.481170+0000 mgr.y (mgr.25069) 342 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:25.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:23.481845+0000 mgr.y (mgr.25069) 343 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:23.481845+0000 mgr.y (mgr.25069) 343 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:23.481845+0000 mgr.y (mgr.25069) 343 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:27.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:25.482576+0000 mgr.y (mgr.25069) 344 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:27.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:25.482576+0000 mgr.y (mgr.25069) 344 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:27.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:25.482576+0000 mgr.y (mgr.25069) 344 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:29.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:27.483313+0000 mgr.y (mgr.25069) 345 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:29.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:27.483313+0000 mgr.y (mgr.25069) 345 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:27.483313+0000 mgr.y (mgr.25069) 345 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:31.030 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:29.483943+0000 mgr.y (mgr.25069) 346 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:31.030 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:29.483943+0000 mgr.y (mgr.25069) 346 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:29.483943+0000 mgr.y (mgr.25069) 346 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:31.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:07:32.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:30.669504+0000 mgr.y (mgr.25069) 347 : audit [DBG] from='client.64474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:32.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:31 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:30.669504+0000 mgr.y (mgr.25069) 347 : audit [DBG] from='client.64474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:32.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:31 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:30.669504+0000 mgr.y (mgr.25069) 347 : audit [DBG] from='client.64474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:33.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:31.484490+0000 mgr.y (mgr.25069) 348 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:33.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:31.484490+0000 mgr.y (mgr.25069) 348 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:33.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:31.484490+0000 mgr.y (mgr.25069) 348 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:07:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (7m) 2m ago 31m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:07:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (7m) 29s ago 30m 57.4M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:07:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (8m) 29s ago 34m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:07:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (18m) 2m ago 36m 427M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:07:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (6m) 2m ago 36m 72.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (6m) 29s ago 34m 73.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (5m) 2m ago 35m 63.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (8m) 2m ago 31m 13.4M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (8m) 29s ago 31m 22.9M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (4m) 2m ago 34m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (4m) 2m ago 33m 40.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (3m) 2m ago 33m 41.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (2m) 2m ago 33m 15.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (2m) 29s ago 33m 41.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (94s) 29s ago 32m 40.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (62s) 29s ago 32m 40.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc c4fd746dfb98 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (34s) 29s ago 32m 13.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 660a4a57cca9 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (8m) 29s ago 31m 65.3M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (29m) 2m ago 29m 41.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:07:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (29m) 29s ago 29m 41.1M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.465437+0000 mon.b (mon.2) 437 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.466263+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.466729+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.467117+0000 mon.b (mon.2) 440 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.467470+0000 mon.b (mon.2) 441 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.467811+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.469851+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.470352+0000 mon.b (mon.2) 444 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.470805+0000 mon.b (mon.2) 445 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.471457+0000 mon.b (mon.2) 446 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.471870+0000 mon.b (mon.2) 447 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.465437+0000 mon.b (mon.2) 437 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.466263+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.466729+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.467117+0000 mon.b (mon.2) 440 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.467470+0000 mon.b (mon.2) 441 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.467811+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.469851+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.470352+0000 mon.b (mon.2) 444 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.470805+0000 mon.b (mon.2) 445 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.471457+0000 mon.b (mon.2) 446 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.177 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.471870+0000 mon.b (mon.2) 447 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 1'"'"'' 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.465437+0000 mon.b (mon.2) 437 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.466263+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.466729+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.467117+0000 mon.b (mon.2) 440 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.467470+0000 mon.b (mon.2) 441 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.467811+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.469851+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:34.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.470352+0000 mon.b (mon.2) 444 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.470805+0000 mon.b (mon.2) 445 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.471457+0000 mon.b (mon.2) 446 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:34.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.471870+0000 mon.b (mon.2) 447 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:35.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:33.463250+0000 mgr.y (mgr.25069) 349 : audit [DBG] from='client.64480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:35.260 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:33.484903+0000 mgr.y (mgr.25069) 350 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:35.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:33.463250+0000 mgr.y (mgr.25069) 349 : audit [DBG] from='client.64480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:35.260 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:33.484903+0000 mgr.y (mgr.25069) 350 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:35.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:33.463250+0000 mgr.y (mgr.25069) 349 : audit [DBG] from='client.64480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:35.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:33.484903+0000 mgr.y (mgr.25069) 350 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:36.358 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:07:36.990 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:35.485697+0000 mgr.y (mgr.25069) 351 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:36.991 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:36.346376+0000 mon.c (mon.1) 15 : audit [DBG] from='client.64486 172.21.15.40:0/2973903928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:36.991 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:35.485697+0000 mgr.y (mgr.25069) 351 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:36.991 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:36.346376+0000 mon.c (mon.1) 15 : audit [DBG] from='client.64486 172.21.15.40:0/2973903928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:37.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.osd | keys'"'"' | grep $sha1' 2024-02-10T09:07:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:35.485697+0000 mgr.y (mgr.25069) 351 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:36.346376+0000 mon.c (mon.1) 15 : audit [DBG] from='client.64486 172.21.15.40:0/2973903928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:39.233 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-10T09:07:39.255 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:37.486143+0000 mgr.y (mgr.25069) 352 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:39.256 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:37.486143+0000 mgr.y (mgr.25069) 352 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:39.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:37.486143+0000 mgr.y (mgr.25069) 352 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:40.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.r.z' 2024-02-10T09:07:40.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:39.221643+0000 mon.a (mon.0) 701 : audit [DBG] from='client.54549 172.21.15.40:0/2584019474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:40.402 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:39.221643+0000 mon.a (mon.0) 701 : audit [DBG] from='client.54549 172.21.15.40:0/2584019474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:40.403 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:39.221643+0000 mon.a (mon.0) 701 : audit [DBG] from='client.54549 172.21.15.40:0/2584019474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:39.486865+0000 mgr.y (mgr.25069) 353 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:41.295 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:39.486865+0000 mgr.y (mgr.25069) 353 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:41.295 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:39.486865+0000 mgr.y (mgr.25069) 353 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.428741+0000 mon.b (mon.2) 448 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T09:07:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.429095+0000 mon.b (mon.2) 449 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T09:07:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.429360+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T09:07:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.429407+0000 mon.b (mon.2) 450 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.429792+0000 mon.b (mon.2) 451 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.429919+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T09:07:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.430329+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:41.430640+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.428741+0000 mon.b (mon.2) 448 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.429095+0000 mon.b (mon.2) 449 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.429360+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.429407+0000 mon.b (mon.2) 450 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.429792+0000 mon.b (mon.2) 451 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.429919+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.430329+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:41.430640+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.428741+0000 mon.b (mon.2) 448 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.429095+0000 mon.b (mon.2) 449 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T09:07:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.429360+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-10T09:07:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.429407+0000 mon.b (mon.2) 450 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.429792+0000 mon.b (mon.2) 451 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.429919+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-02-10T09:07:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.430329+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-10T09:07:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:41.430640+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-10T09:07:43.142 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:41.487321+0000 mgr.y (mgr.25069) 354 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:43.142 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:42.115181+0000 mgr.y (mgr.25069) 355 : audit [DBG] from='client.64498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "services": "rgw.r.z", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:43.142 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:41.487321+0000 mgr.y (mgr.25069) 354 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:43.143 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:42.115181+0000 mgr.y (mgr.25069) 355 : audit [DBG] from='client.64498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "services": "rgw.r.z", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:41.487321+0000 mgr.y (mgr.25069) 354 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:43.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:42.115181+0000 mgr.y (mgr.25069) 355 : audit [DBG] from='client.64498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "services": "rgw.r.z", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:43.575 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:44.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:07:44.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:43.487971+0000 mgr.y (mgr.25069) 356 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:44.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:43.568671+0000 mgr.y (mgr.25069) 357 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:44.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:43.574134+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:44.914 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:43.928087+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:44.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:43.931758+0000 mgr.y (mgr.25069) 358 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:44.915 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:43.487971+0000 mgr.y (mgr.25069) 356 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:44.915 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:43.568671+0000 mgr.y (mgr.25069) 357 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:44.915 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:43.574134+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:44.915 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:43.928087+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:44.916 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:43.931758+0000 mgr.y (mgr.25069) 358 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:45.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:43.487971+0000 mgr.y (mgr.25069) 356 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:45.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:43.568671+0000 mgr.y (mgr.25069) 357 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:45.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:43.574134+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:45.032 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:43.928087+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:45.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:43.931758+0000 mgr.y (mgr.25069) 358 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:07:47.087 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:45.488571+0000 mgr.y (mgr.25069) 359 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:47.087 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.085614+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.088612+0000 mgr.y (mgr.25069) 360 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.088688+0000 mgr.y (mgr.25069) 361 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.089688+0000 mon.b (mon.2) 452 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.095686+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.100354+0000 mon.b (mon.2) 453 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.101139+0000 mgr.y (mgr.25069) 362 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.105214+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.109594+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.110369+0000 mgr.y (mgr.25069) 363 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.114494+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.118477+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.119272+0000 mgr.y (mgr.25069) 364 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:07:47.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.122936+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.127344+0000 mon.b (mon.2) 456 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.128130+0000 mgr.y (mgr.25069) 365 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:07:47.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.131790+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.367 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:07:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.136384+0000 mon.b (mon.2) 457 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:46.137128+0000 mgr.y (mgr.25069) 366 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:07:47.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:46.140849+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:45.488571+0000 mgr.y (mgr.25069) 359 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.085614+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.088612+0000 mgr.y (mgr.25069) 360 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.088688+0000 mgr.y (mgr.25069) 361 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.089688+0000 mon.b (mon.2) 452 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.095686+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.100354+0000 mon.b (mon.2) 453 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.101139+0000 mgr.y (mgr.25069) 362 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.105214+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.109594+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.110369+0000 mgr.y (mgr.25069) 363 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.114494+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.118477+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.119272+0000 mgr.y (mgr.25069) 364 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.122936+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.127344+0000 mon.b (mon.2) 456 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.128130+0000 mgr.y (mgr.25069) 365 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.131790+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.136384+0000 mon.b (mon.2) 457 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:46.137128+0000 mgr.y (mgr.25069) 366 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:07:47.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:47 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:46.140849+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:45.488571+0000 mgr.y (mgr.25069) 359 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.085614+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.088612+0000 mgr.y (mgr.25069) 360 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.088688+0000 mgr.y (mgr.25069) 361 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.089688+0000 mon.b (mon.2) 452 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.095686+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.100354+0000 mon.b (mon.2) 453 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.101139+0000 mgr.y (mgr.25069) 362 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.105214+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.109594+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.110369+0000 mgr.y (mgr.25069) 363 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.114494+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.118477+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.119272+0000 mgr.y (mgr.25069) 364 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.122936+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.127344+0000 mon.b (mon.2) 456 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.128130+0000 mgr.y (mgr.25069) 365 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:07:47.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.131790+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:47.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.136384+0000 mon.b (mon.2) 457 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:47.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:46.137128+0000 mgr.y (mgr.25069) 366 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:07:47.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:46.140849+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:48.030 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:07:48.030 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (8m) 2m ago 31m 14.0M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:07:48.030 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (7m) 43s ago 31m 57.4M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:07:48.030 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (8m) 43s ago 34m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:07:48.030 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (18m) 2m ago 36m 427M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:07:48.030 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (6m) 2m ago 36m 72.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (7m) 43s ago 35m 73.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (5m) 2m ago 35m 63.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (8m) 2m ago 31m 13.4M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (8m) 43s ago 31m 22.9M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (4m) 2m ago 34m 39.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (4m) 2m ago 34m 40.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (3m) 2m ago 33m 41.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (2m) 2m ago 33m 15.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (2m) 43s ago 33m 41.5M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (108s) 43s ago 32m 40.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (77s) 43s ago 32m 40.8M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc c4fd746dfb98 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (48s) 43s ago 32m 13.0M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 660a4a57cca9 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (8m) 43s ago 31m 65.3M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:07:48.031 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (29m) 2m ago 29m 41.0M - 15.2.0 204a01f9b0b6 8432d04a8751 2024-02-10T09:07:48.032 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (29m) 43s ago 29m 41.1M - 15.2.0 204a01f9b0b6 55d99cc72c2c 2024-02-10T09:07:48.440 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:07:48.440 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:07:48.440 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:07:48.440 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:48.440 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:07:48.440 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 8 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 13 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:07:48.441 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:07:48.789 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "in_progress": true, 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "which": "Upgrading daemons in service(s) rgw.r.z", 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "services_complete": [], 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "progress": "0/2 daemons upgraded", 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "Currently upgrading rgw daemons", 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout: "is_paused": false 2024-02-10T09:07:48.790 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.356461+0000 mgr.y (mgr.25069) 367 : audit [DBG] from='client.64504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:47.489078+0000 mgr.y (mgr.25069) 368 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.687047+0000 mgr.y (mgr.25069) 369 : audit [DBG] from='client.64510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:47.945181+0000 mgr.y (mgr.25069) 370 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi040.skjeib (1/2) 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.951320+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.952512+0000 mon.b (mon.2) 458 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:48.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.952949+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.955298+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:47.956010+0000 mgr.y (mgr.25069) 371 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:47.956621+0000 mon.b (mon.2) 460 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi040.skjeib","key": "container_image"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.016897+0000 mgr.y (mgr.25069) 372 : audit [DBG] from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.019065+0000 mon.b (mon.2) 461 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.019597+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.020035+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.020494+0000 mon.b (mon.2) 464 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.021044+0000 mon.b (mon.2) 465 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.021491+0000 mon.b (mon.2) 466 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.356461+0000 mgr.y (mgr.25069) 367 : audit [DBG] from='client.64504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:47.489078+0000 mgr.y (mgr.25069) 368 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.687047+0000 mgr.y (mgr.25069) 369 : audit [DBG] from='client.64510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:47.945181+0000 mgr.y (mgr.25069) 370 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi040.skjeib (1/2) 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.951320+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.952512+0000 mon.b (mon.2) 458 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.952949+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.955298+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:47.956010+0000 mgr.y (mgr.25069) 371 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:47.956621+0000 mon.b (mon.2) 460 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi040.skjeib","key": "container_image"}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.016897+0000 mgr.y (mgr.25069) 372 : audit [DBG] from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.019065+0000 mon.b (mon.2) 461 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:48.955 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.019597+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.020035+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.020494+0000 mon.b (mon.2) 464 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.021044+0000 mon.b (mon.2) 465 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.021491+0000 mon.b (mon.2) 466 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.023278+0000 mon.b (mon.2) 467 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.023793+0000 mon.b (mon.2) 468 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.024267+0000 mon.b (mon.2) 469 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.024750+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.025171+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:48.956 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.440377+0000 mon.c (mon.1) 16 : audit [DBG] from='client.64522 172.21.15.40:0/2558933720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.356461+0000 mgr.y (mgr.25069) 367 : audit [DBG] from='client.64504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:47.489078+0000 mgr.y (mgr.25069) 368 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.687047+0000 mgr.y (mgr.25069) 369 : audit [DBG] from='client.64510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:47.945181+0000 mgr.y (mgr.25069) 370 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi040.skjeib (1/2) 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.951320+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.952512+0000 mon.b (mon.2) 458 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.952949+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi040.skjeib", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.955298+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:47.956010+0000 mgr.y (mgr.25069) 371 : cephadm [INF] Deploying daemon rgw.r.z.smithi040.skjeib on smithi040 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:47.956621+0000 mon.b (mon.2) 460 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi040.skjeib","key": "container_image"}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.016897+0000 mgr.y (mgr.25069) 372 : audit [DBG] from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.019065+0000 mon.b (mon.2) 461 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.019597+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.020035+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.020494+0000 mon.b (mon.2) 464 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.021044+0000 mon.b (mon.2) 465 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.021491+0000 mon.b (mon.2) 466 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.023278+0000 mon.b (mon.2) 467 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.023793+0000 mon.b (mon.2) 468 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.024267+0000 mon.b (mon.2) 469 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.024750+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.025171+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.440377+0000 mon.c (mon.1) 16 : audit [DBG] from='client.64522 172.21.15.40:0/2558933720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:49.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.023278+0000 mon.b (mon.2) 467 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:07:49.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.023793+0000 mon.b (mon.2) 468 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.024267+0000 mon.b (mon.2) 469 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.024750+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.025171+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:07:49.301 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.440377+0000 mon.c (mon.1) 16 : audit [DBG] from='client.64522 172.21.15.40:0/2558933720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:07:50.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:48.789674+0000 mgr.y (mgr.25069) 373 : audit [DBG] from='client.54585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:50.370 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:48.789674+0000 mgr.y (mgr.25069) 373 : audit [DBG] from='client.54585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:50.370 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:49 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:48.789674+0000 mgr.y (mgr.25069) 373 : audit [DBG] from='client.54585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:07:51.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:49.489595+0000 mgr.y (mgr.25069) 374 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:49.489595+0000 mgr.y (mgr.25069) 374 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:51.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:49.489595+0000 mgr.y (mgr.25069) 374 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:52.733 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:51.490309+0000 mgr.y (mgr.25069) 375 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:52.734 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:51.626100+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:52.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:51.490309+0000 mgr.y (mgr.25069) 375 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:52.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:51.626100+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:51.490309+0000 mgr.y (mgr.25069) 375 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:07:52.926 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:51.626100+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:53.143960+0000 mgr.y (mgr.25069) 376 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi145.uizklq (2/2) 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:53.149268+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:53.150359+0000 mon.b (mon.2) 472 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:53.150827+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:53.153475+0000 mon.b (mon.2) 473 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:07:53.154581+0000 mgr.y (mgr.25069) 377 : cephadm [INF] Deploying daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:53.155253+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi145.uizklq","key": "container_image"}]: dispatch 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:53.143960+0000 mgr.y (mgr.25069) 376 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi145.uizklq (2/2) 2024-02-10T09:07:54.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:53.149268+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:53.150359+0000 mon.b (mon.2) 472 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:53.150827+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:53.153475+0000 mon.b (mon.2) 473 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:07:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:07:53.154581+0000 mgr.y (mgr.25069) 377 : cephadm [INF] Deploying daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T09:07:54.429 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:53.155253+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi145.uizklq","key": "container_image"}]: dispatch 2024-02-10T09:07:54.446 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:53.143960+0000 mgr.y (mgr.25069) 376 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi145.uizklq (2/2) 2024-02-10T09:07:54.446 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:53.149268+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:54.446 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:53.150359+0000 mon.b (mon.2) 472 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:54.446 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:53.150827+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi145.uizklq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-10T09:07:54.446 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:53.153475+0000 mon.b (mon.2) 473 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-10T09:07:54.447 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:07:53.154581+0000 mgr.y (mgr.25069) 377 : cephadm [INF] Deploying daemon rgw.r.z.smithi145.uizklq on smithi145 2024-02-10T09:07:54.447 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:53.155253+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi145.uizklq","key": "container_image"}]: dispatch 2024-02-10T09:07:55.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:53.490923+0000 mgr.y (mgr.25069) 378 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-10T09:07:55.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:55 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:53.490923+0000 mgr.y (mgr.25069) 378 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-10T09:07:55.463 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:53.490923+0000 mgr.y (mgr.25069) 378 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-10T09:07:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:55.491560+0000 mgr.y (mgr.25069) 379 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 46 KiB/s rd, 170 B/s wr, 71 op/s 2024-02-10T09:07:57.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:56.611704+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:56.615999+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:57.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:56.616372+0000 mon.b (mon.2) 476 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:55.491560+0000 mgr.y (mgr.25069) 379 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 46 KiB/s rd, 170 B/s wr, 71 op/s 2024-02-10T09:07:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:56.611704+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:56.615999+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:57.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:56.616372+0000 mon.b (mon.2) 476 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:55.491560+0000 mgr.y (mgr.25069) 379 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 46 KiB/s rd, 170 B/s wr, 71 op/s 2024-02-10T09:07:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:56.611704+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:07:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:56.615999+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:57.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:56.616372+0000 mon.b (mon.2) 476 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-10T09:07:59.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:07:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:57.492018+0000 mgr.y (mgr.25069) 380 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 54 KiB/s rd, 170 B/s wr, 83 op/s 2024-02-10T09:07:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:07:59 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:57.492018+0000 mgr.y (mgr.25069) 380 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 54 KiB/s rd, 170 B/s wr, 83 op/s 2024-02-10T09:07:59.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:07:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:57.492018+0000 mgr.y (mgr.25069) 380 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 54 KiB/s rd, 170 B/s wr, 83 op/s 2024-02-10T09:08:00.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:07:59.334983+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:07:59.492611+0000 mgr.y (mgr.25069) 381 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 90 KiB/s rd, 255 B/s wr, 139 op/s 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.218862+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.224306+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.231605+0000 mon.b (mon.2) 477 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.235339+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.236960+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.238300+0000 mon.b (mon.2) 480 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.240114+0000 mon.b (mon.2) 481 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.242044+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.243599+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.244335+0000 mgr.y (mgr.25069) 382 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-10T09:08:00.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.248958+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.251170+0000 mon.b (mon.2) 484 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.251528+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.254788+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]': finished 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:07:59.334983+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:07:59.492611+0000 mgr.y (mgr.25069) 381 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 90 KiB/s rd, 255 B/s wr, 139 op/s 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.218862+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.224306+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.231605+0000 mon.b (mon.2) 477 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:08:00.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.235339+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.236960+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.238300+0000 mon.b (mon.2) 480 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.240114+0000 mon.b (mon.2) 481 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.242044+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.243599+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.244335+0000 mgr.y (mgr.25069) 382 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.248958+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.251170+0000 mon.b (mon.2) 484 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.251528+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:08:00.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.254788+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]': finished 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.257698+0000 mon.b (mon.2) 485 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.258058+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.261238+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]': finished 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.264290+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.270284+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.272363+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.273541+0000 mon.b (mon.2) 488 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.279143+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.280537+0000 mon.b (mon.2) 489 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.285798+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.287512+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.288882+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.290268+0000 mon.b (mon.2) 492 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.291488+0000 mon.b (mon.2) 493 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.293465+0000 mon.b (mon.2) 494 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.293816+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:00.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.298113+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:08:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.257698+0000 mon.b (mon.2) 485 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:08:00.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.258058+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.261238+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]': finished 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.264290+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.270284+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.272363+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.273541+0000 mon.b (mon.2) 488 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.279143+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.280537+0000 mon.b (mon.2) 489 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.285798+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.287512+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.288882+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.290268+0000 mon.b (mon.2) 492 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.291488+0000 mon.b (mon.2) 493 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.293465+0000 mon.b (mon.2) 494 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.293816+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:00.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.298113+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.298935+0000 mon.b (mon.2) 495 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.299208+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.303058+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.303853+0000 mon.b (mon.2) 496 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.304159+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.307951+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.308932+0000 mon.b (mon.2) 497 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.309271+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.313078+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:08:00.683 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.313852+0000 mon.b (mon.2) 498 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.314120+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.317959+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.318720+0000 mon.b (mon.2) 499 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.318978+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.323996+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.324795+0000 mon.b (mon.2) 500 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.325112+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.330216+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.330984+0000 mon.b (mon.2) 501 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.331245+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.298935+0000 mon.b (mon.2) 495 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.299208+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.303058+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.303853+0000 mon.b (mon.2) 496 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.304159+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.307951+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.308932+0000 mon.b (mon.2) 497 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.309271+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.313078+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:08:00.685 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.313852+0000 mon.b (mon.2) 498 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.314120+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.317959+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.318720+0000 mon.b (mon.2) 499 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.318978+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.323996+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.324795+0000 mon.b (mon.2) 500 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.325112+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.330216+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.330984+0000 mon.b (mon.2) 501 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.331245+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:07:59.334983+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:07:59.492611+0000 mgr.y (mgr.25069) 381 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 90 KiB/s rd, 255 B/s wr, 139 op/s 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.218862+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.224306+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.231605+0000 mon.b (mon.2) 477 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.235339+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.236960+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.238300+0000 mon.b (mon.2) 480 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.240114+0000 mon.b (mon.2) 481 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.242044+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.243599+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.244335+0000 mgr.y (mgr.25069) 382 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.248958+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.251170+0000 mon.b (mon.2) 484 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.251528+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]: dispatch 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.254788+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi040.skjeib"}]': finished 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.257698+0000 mon.b (mon.2) 485 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.258058+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]: dispatch 2024-02-10T09:08:00.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.261238+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi145.uizklq"}]': finished 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.264290+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.270284+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.272363+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.273541+0000 mon.b (mon.2) 488 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.279143+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.280537+0000 mon.b (mon.2) 489 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.285798+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.287512+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.288882+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.290268+0000 mon.b (mon.2) 492 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.291488+0000 mon.b (mon.2) 493 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.293465+0000 mon.b (mon.2) 494 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.293816+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.298113+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.298935+0000 mon.b (mon.2) 495 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.786 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.299208+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.303058+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.303853+0000 mon.b (mon.2) 496 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.304159+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.307951+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.308932+0000 mon.b (mon.2) 497 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.309271+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.313078+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.313852+0000 mon.b (mon.2) 498 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.314120+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:00.787 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.317959+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.318720+0000 mon.b (mon.2) 499 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.318978+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.323996+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.324795+0000 mon.b (mon.2) 500 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.325112+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.330216+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.330984+0000 mon.b (mon.2) 501 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:00.788 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.331245+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.265093+0000 mgr.y (mgr.25069) 383 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.274244+0000 mgr.y (mgr.25069) 384 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.281227+0000 mgr.y (mgr.25069) 385 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.292189+0000 mgr.y (mgr.25069) 386 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.331829+0000 mon.b (mon.2) 502 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.332052+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.337524+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:08:01.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.338273+0000 mon.b (mon.2) 503 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.338585+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.351528+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.353654+0000 mon.b (mon.2) 504 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.353954+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.354596+0000 mon.b (mon.2) 505 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.354959+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.355756+0000 mon.b (mon.2) 506 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.265093+0000 mgr.y (mgr.25069) 383 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.274244+0000 mgr.y (mgr.25069) 384 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.281227+0000 mgr.y (mgr.25069) 385 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:08:01.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.292189+0000 mgr.y (mgr.25069) 386 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.331829+0000 mon.b (mon.2) 502 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.332052+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.337524+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.338273+0000 mon.b (mon.2) 503 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.338585+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.351528+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.353654+0000 mon.b (mon.2) 504 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.353954+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.354596+0000 mon.b (mon.2) 505 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.354959+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.355756+0000 mon.b (mon.2) 506 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.678 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.356096+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.356863+0000 mon.b (mon.2) 507 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.357162+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.357875+0000 mon.b (mon.2) 508 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.358144+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.361519+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.364337+0000 mgr.y (mgr.25069) 387 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.364691+0000 mon.b (mon.2) 509 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.365023+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.367579+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:00.372411+0000 mgr.y (mgr.25069) 388 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.636149+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.641824+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.647198+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.660327+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:00.669427+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.356096+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.356863+0000 mon.b (mon.2) 507 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.357162+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.357875+0000 mon.b (mon.2) 508 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.358144+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.361519+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.364337+0000 mgr.y (mgr.25069) 387 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.364691+0000 mon.b (mon.2) 509 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.365023+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.367579+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:00.372411+0000 mgr.y (mgr.25069) 388 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-10T09:08:01.680 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.636149+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.641824+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.647198+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.660327+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:01 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:00.669427+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.265093+0000 mgr.y (mgr.25069) 383 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:08:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.274244+0000 mgr.y (mgr.25069) 384 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:08:01.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.281227+0000 mgr.y (mgr.25069) 385 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.292189+0000 mgr.y (mgr.25069) 386 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.331829+0000 mon.b (mon.2) 502 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.332052+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.337524+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.338273+0000 mon.b (mon.2) 503 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.338585+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.351528+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.353654+0000 mon.b (mon.2) 504 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.353954+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.354596+0000 mon.b (mon.2) 505 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.354959+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.355756+0000 mon.b (mon.2) 506 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.356096+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.783 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.356863+0000 mon.b (mon.2) 507 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.357162+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.357875+0000 mon.b (mon.2) 508 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.358144+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.361519+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.364337+0000 mgr.y (mgr.25069) 387 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.364691+0000 mon.b (mon.2) 509 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.365023+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.367579+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:00.372411+0000 mgr.y (mgr.25069) 388 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.636149+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.641824+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.784 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.647198+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.660327+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:01.785 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:00.669427+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:01.493375+0000 mgr.y (mgr.25069) 389 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 109 KiB/s rd, 255 B/s wr, 168 op/s 2024-02-10T09:08:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:01.817708+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:01.493375+0000 mgr.y (mgr.25069) 389 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 109 KiB/s rd, 255 B/s wr, 168 op/s 2024-02-10T09:08:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:01.817708+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:01.493375+0000 mgr.y (mgr.25069) 389 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 109 KiB/s rd, 255 B/s wr, 168 op/s 2024-02-10T09:08:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:01.817708+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:05.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:03.493996+0000 mgr.y (mgr.25069) 390 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 110 KiB/s rd, 341 B/s wr, 168 op/s 2024-02-10T09:08:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:03.493996+0000 mgr.y (mgr.25069) 390 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 110 KiB/s rd, 341 B/s wr, 168 op/s 2024-02-10T09:08:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:03.493996+0000 mgr.y (mgr.25069) 390 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 110 KiB/s rd, 341 B/s wr, 168 op/s 2024-02-10T09:08:07.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:05.494876+0000 mgr.y (mgr.25069) 391 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 103 KiB/s rd, 426 B/s wr, 157 op/s 2024-02-10T09:08:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:05.494876+0000 mgr.y (mgr.25069) 391 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 103 KiB/s rd, 426 B/s wr, 157 op/s 2024-02-10T09:08:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:05.494876+0000 mgr.y (mgr.25069) 391 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 103 KiB/s rd, 426 B/s wr, 157 op/s 2024-02-10T09:08:09.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:07.495574+0000 mgr.y (mgr.25069) 392 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 66 KiB/s rd, 255 B/s wr, 100 op/s 2024-02-10T09:08:09.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:07.495574+0000 mgr.y (mgr.25069) 392 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 66 KiB/s rd, 255 B/s wr, 100 op/s 2024-02-10T09:08:09.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:07.495574+0000 mgr.y (mgr.25069) 392 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 66 KiB/s rd, 255 B/s wr, 100 op/s 2024-02-10T09:08:11.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:09.496183+0000 mgr.y (mgr.25069) 393 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s rd, 255 B/s wr, 87 op/s 2024-02-10T09:08:11.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:09.496183+0000 mgr.y (mgr.25069) 393 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s rd, 255 B/s wr, 87 op/s 2024-02-10T09:08:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:09.496183+0000 mgr.y (mgr.25069) 393 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s rd, 255 B/s wr, 87 op/s 2024-02-10T09:08:13.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:11.496725+0000 mgr.y (mgr.25069) 394 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s rd, 170 B/s wr, 32 op/s 2024-02-10T09:08:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:11.496725+0000 mgr.y (mgr.25069) 394 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s rd, 170 B/s wr, 32 op/s 2024-02-10T09:08:13.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:11.496725+0000 mgr.y (mgr.25069) 394 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s rd, 170 B/s wr, 32 op/s 2024-02-10T09:08:15.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:13.497312+0000 mgr.y (mgr.25069) 395 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-10T09:08:15.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:13.497312+0000 mgr.y (mgr.25069) 395 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-10T09:08:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:13.497312+0000 mgr.y (mgr.25069) 395 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-10T09:08:17.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:15.498145+0000 mgr.y (mgr.25069) 396 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-02-10T09:08:17.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:15.498145+0000 mgr.y (mgr.25069) 396 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-02-10T09:08:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:15.498145+0000 mgr.y (mgr.25069) 396 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-02-10T09:08:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:17.498717+0000 mgr.y (mgr.25069) 397 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:19.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:17.498717+0000 mgr.y (mgr.25069) 397 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:17.498717+0000 mgr.y (mgr.25069) 397 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:19.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:08:20.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:19.139485+0000 mgr.y (mgr.25069) 398 : audit [DBG] from='client.54669 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:20.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:19 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:19.139485+0000 mgr.y (mgr.25069) 398 : audit [DBG] from='client.54669 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:20.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:19 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:19.139485+0000 mgr.y (mgr.25069) 398 : audit [DBG] from='client.54669 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:19.499301+0000 mgr.y (mgr.25069) 399 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:19.499301+0000 mgr.y (mgr.25069) 399 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:19.499301+0000 mgr.y (mgr.25069) 399 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (8m) 22s ago 31m 23.4M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (8m) 21s ago 31m 57.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (9m) 21s ago 35m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (18m) 22s ago 37m 430M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (6m) 22s ago 37m 125M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (7m) 21s ago 35m 75.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:08:21.906 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (6m) 22s ago 35m 73.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (9m) 22s ago 32m 20.0M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (9m) 21s ago 32m 22.8M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (5m) 22s ago 35m 45.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (5m) 22s ago 34m 45.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (4m) 22s ago 34m 44.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (3m) 22s ago 34m 47.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (2m) 21s ago 33m 44.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (2m) 21s ago 33m 42.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (111s) 21s ago 33m 43.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc c4fd746dfb98 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (82s) 21s ago 32m 42.2M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 660a4a57cca9 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (8m) 21s ago 32m 65.3M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (30s) 22s ago 30m 38.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc bc07d31cf6b9 2024-02-10T09:08:21.907 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (25s) 21s ago 30m 38.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc 78726f4517ba 2024-02-10T09:08:22.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.rgw | length == 1'"'"'' 2024-02-10T09:08:23.139 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:21.499837+0000 mgr.y (mgr.25069) 400 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.892567+0000 mgr.y (mgr.25069) 401 : audit [DBG] from='client.54675 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.894751+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.895537+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.895947+0000 mon.b (mon.2) 512 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.896301+0000 mon.b (mon.2) 513 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.896635+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.896944+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.898993+0000 mon.b (mon.2) 516 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.899549+0000 mon.b (mon.2) 517 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.899914+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.900252+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:21.900613+0000 mon.b (mon.2) 520 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:21.499837+0000 mgr.y (mgr.25069) 400 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.892567+0000 mgr.y (mgr.25069) 401 : audit [DBG] from='client.54675 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.894751+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.895537+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.895947+0000 mon.b (mon.2) 512 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.896301+0000 mon.b (mon.2) 513 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.896635+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.896944+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.898993+0000 mon.b (mon.2) 516 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.899549+0000 mon.b (mon.2) 517 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.141 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.899914+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.142 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.900252+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.142 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:21.900613+0000 mon.b (mon.2) 520 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:21.499837+0000 mgr.y (mgr.25069) 400 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.892567+0000 mgr.y (mgr.25069) 401 : audit [DBG] from='client.54675 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.894751+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.895537+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.895947+0000 mon.b (mon.2) 512 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.896301+0000 mon.b (mon.2) 513 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.896635+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.896944+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.898993+0000 mon.b (mon.2) 516 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.899549+0000 mon.b (mon.2) 517 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.899914+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.900252+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:23.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:21.900613+0000 mon.b (mon.2) 520 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:24.416 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:08:25.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:23.500372+0000 mgr.y (mgr.25069) 402 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:25.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:24.405344+0000 mon.c (mon.1) 17 : audit [DBG] from='client.54681 172.21.15.40:0/495296295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:23.500372+0000 mgr.y (mgr.25069) 402 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:24.405344+0000 mon.c (mon.1) 17 : audit [DBG] from='client.54681 172.21.15.40:0/495296295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:25.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.rgw | keys'"'"' | grep $sha1' 2024-02-10T09:08:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:23.500372+0000 mgr.y (mgr.25069) 402 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:24.405344+0000 mon.c (mon.1) 17 : audit [DBG] from='client.54681 172.21.15.40:0/495296295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:27.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:25.501121+0000 mgr.y (mgr.25069) 403 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:27.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:25.501121+0000 mgr.y (mgr.25069) 403 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:27.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:25.501121+0000 mgr.y (mgr.25069) 403 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:27.364 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-10T09:08:27.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-10T09:08:28.013 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:27.353317+0000 mon.a (mon.0) 765 : audit [DBG] from='client.54687 172.21.15.40:0/1449861345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:28.013 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:27 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:27.353317+0000 mon.a (mon.0) 765 : audit [DBG] from='client.54687 172.21.15.40:0/1449861345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:28.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:27 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:27.353317+0000 mon.a (mon.0) 765 : audit [DBG] from='client.54687 172.21.15.40:0/1449861345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:29.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:27.501764+0000 mgr.y (mgr.25069) 404 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:29.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:27.501764+0000 mgr.y (mgr.25069) 404 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:27.501764+0000 mgr.y (mgr.25069) 404 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:30.556 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-10T09:08:30.567 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T09:08:30.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-10T09:08:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:29.502278+0000 mgr.y (mgr.25069) 405 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:31.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:29.922649+0000 mgr.y (mgr.25069) 406 : audit [DBG] from='client.64630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:29.923207+0000 mgr.y (mgr.25069) 407 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:29.927158+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:29.957268+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:29.960824+0000 mgr.y (mgr.25069) 408 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:29.502278+0000 mgr.y (mgr.25069) 405 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:29.922649+0000 mgr.y (mgr.25069) 406 : audit [DBG] from='client.64630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:29.923207+0000 mgr.y (mgr.25069) 407 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:29.927158+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:29.957268+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:29.960824+0000 mgr.y (mgr.25069) 408 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:29.502278+0000 mgr.y (mgr.25069) 405 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:29.922649+0000 mgr.y (mgr.25069) 406 : audit [DBG] from='client.64630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:29.923207+0000 mgr.y (mgr.25069) 407 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:29.927158+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:29.957268+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:29.960824+0000 mgr.y (mgr.25069) 408 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:31.502908+0000 mgr.y (mgr.25069) 409 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.235488+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.236079+0000 mgr.y (mgr.25069) 410 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.236155+0000 mgr.y (mgr.25069) 411 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.237328+0000 mon.b (mon.2) 521 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.244867+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.246776+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.247490+0000 mgr.y (mgr.25069) 412 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.254231+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.256102+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.256883+0000 mgr.y (mgr.25069) 413 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.263150+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.264775+0000 mon.b (mon.2) 524 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.265459+0000 mgr.y (mgr.25069) 414 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.271713+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.273825+0000 mon.b (mon.2) 525 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.278625+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.280611+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.285570+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.287385+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.292256+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.293905+0000 mon.b (mon.2) 528 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.298405+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.301728+0000 mon.b (mon.2) 529 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.304157+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.308936+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.312378+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.317565+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.320801+0000 mon.b (mon.2) 532 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.323559+0000 mon.b (mon.2) 533 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.326196+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.329043+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.332588+0000 mon.b (mon.2) 536 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.332876+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.336657+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.339043+0000 mon.b (mon.2) 537 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.339307+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.342726+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.345383+0000 mon.b (mon.2) 538 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.345850+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.349310+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.351912+0000 mon.b (mon.2) 539 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.352414+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.355992+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.357027+0000 mon.b (mon.2) 540 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.357286+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.360925+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.361814+0000 mon.b (mon.2) 541 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.362188+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.365030+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.365824+0000 mon.b (mon.2) 542 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.366086+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:33.536 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.368837+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.369546+0000 mon.b (mon.2) 543 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.369819+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.371169+0000 mon.b (mon.2) 544 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.371537+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.374367+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.375082+0000 mon.b (mon.2) 545 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.375333+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.378113+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.378982+0000 mon.b (mon.2) 546 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.379234+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.537 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.379899+0000 mon.b (mon.2) 547 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.380129+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.380783+0000 mon.b (mon.2) 548 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.381003+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.381668+0000 mon.b (mon.2) 549 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.381891+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.382591+0000 mon.b (mon.2) 550 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.382944+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.385793+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.386906+0000 mon.b (mon.2) 551 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.387179+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.389324+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:08:33.538 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:33 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:32.393160+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:31.502908+0000 mgr.y (mgr.25069) 409 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.235488+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.236079+0000 mgr.y (mgr.25069) 410 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.236155+0000 mgr.y (mgr.25069) 411 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.237328+0000 mon.b (mon.2) 521 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.244867+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.246776+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.247490+0000 mgr.y (mgr.25069) 412 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.254231+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.256102+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.256883+0000 mgr.y (mgr.25069) 413 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.263150+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.264775+0000 mon.b (mon.2) 524 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.265459+0000 mgr.y (mgr.25069) 414 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.271713+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.273825+0000 mon.b (mon.2) 525 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.278625+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.280611+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:31.502908+0000 mgr.y (mgr.25069) 409 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.235488+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.236079+0000 mgr.y (mgr.25069) 410 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-10T09:08:33.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.236155+0000 mgr.y (mgr.25069) 411 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.237328+0000 mon.b (mon.2) 521 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.244867+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.246776+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.247490+0000 mgr.y (mgr.25069) 412 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.254231+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.256102+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.256883+0000 mgr.y (mgr.25069) 413 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.263150+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.264775+0000 mon.b (mon.2) 524 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.265459+0000 mgr.y (mgr.25069) 414 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.271713+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.273825+0000 mon.b (mon.2) 525 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.278625+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.678 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.280611+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.285570+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.287385+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.292256+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.293905+0000 mon.b (mon.2) 528 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.298405+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.301728+0000 mon.b (mon.2) 529 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.304157+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.308936+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.312378+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.317565+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.320801+0000 mon.b (mon.2) 532 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.323559+0000 mon.b (mon.2) 533 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.679 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.326196+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.329043+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.332588+0000 mon.b (mon.2) 536 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.332876+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:33.680 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.336657+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.285570+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.287385+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.292256+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.293905+0000 mon.b (mon.2) 528 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.298405+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.301728+0000 mon.b (mon.2) 529 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.304157+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.308936+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.312378+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.681 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.317565+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.320801+0000 mon.b (mon.2) 532 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.323559+0000 mon.b (mon.2) 533 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.326196+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.329043+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.332588+0000 mon.b (mon.2) 536 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.332876+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.336657+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.339043+0000 mon.b (mon.2) 537 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.339307+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.342726+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.345383+0000 mon.b (mon.2) 538 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.345850+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.349310+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.351912+0000 mon.b (mon.2) 539 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:33.682 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.352414+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.355992+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.357027+0000 mon.b (mon.2) 540 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.357286+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.360925+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.361814+0000 mon.b (mon.2) 541 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.362188+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.365030+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.365824+0000 mon.b (mon.2) 542 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.366086+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.368837+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.369546+0000 mon.b (mon.2) 543 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.369819+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.371169+0000 mon.b (mon.2) 544 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.371537+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:33.683 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.374367+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.375082+0000 mon.b (mon.2) 545 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.375333+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.378113+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.378982+0000 mon.b (mon.2) 546 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.379234+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.379899+0000 mon.b (mon.2) 547 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.339043+0000 mon.b (mon.2) 537 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.339307+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.342726+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.345383+0000 mon.b (mon.2) 538 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:33.684 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.345850+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.349310+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.351912+0000 mon.b (mon.2) 539 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.352414+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.355992+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.357027+0000 mon.b (mon.2) 540 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.357286+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.360925+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-10T09:08:33.685 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.361814+0000 mon.b (mon.2) 541 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.362188+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.365030+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.380129+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.380783+0000 mon.b (mon.2) 548 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.381003+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.381668+0000 mon.b (mon.2) 549 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.381891+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.382591+0000 mon.b (mon.2) 550 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.382944+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.385793+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.386906+0000 mon.b (mon.2) 551 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:33.686 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.387179+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.389324+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:32.393160+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.365824+0000 mon.b (mon.2) 542 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.366086+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.368837+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.369546+0000 mon.b (mon.2) 543 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.369819+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.371169+0000 mon.b (mon.2) 544 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.371537+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-10T09:08:33.687 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.374367+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.375082+0000 mon.b (mon.2) 545 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.375333+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.378113+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.378982+0000 mon.b (mon.2) 546 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.379234+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.379899+0000 mon.b (mon.2) 547 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.380129+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.380783+0000 mon.b (mon.2) 548 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.381003+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.381668+0000 mon.b (mon.2) 549 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.381891+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.382591+0000 mon.b (mon.2) 550 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.382944+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.385793+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-10T09:08:33.688 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.386906+0000 mon.b (mon.2) 551 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:33.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.387179+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-10T09:08:33.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.389324+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-10T09:08:33.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:33 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:32.393160+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:33.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.274466+0000 mgr.y (mgr.25069) 415 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.281397+0000 mgr.y (mgr.25069) 416 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.288054+0000 mgr.y (mgr.25069) 417 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.294504+0000 mgr.y (mgr.25069) 418 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.302472+0000 mgr.y (mgr.25069) 419 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.304794+0000 mgr.y (mgr.25069) 420 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.313306+0000 mgr.y (mgr.25069) 421 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.321489+0000 mgr.y (mgr.25069) 422 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.324189+0000 mgr.y (mgr.25069) 423 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:08:34.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.326882+0000 mgr.y (mgr.25069) 424 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.329690+0000 mgr.y (mgr.25069) 425 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.331176+0000 mgr.y (mgr.25069) 426 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cephadm 2024-02-10T09:08:32.386434+0000 mgr.y (mgr.25069) 427 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:33.192599+0000 mgr.y (mgr.25069) 428 : audit [DBG] from='client.54699 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.274466+0000 mgr.y (mgr.25069) 415 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.281397+0000 mgr.y (mgr.25069) 416 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.288054+0000 mgr.y (mgr.25069) 417 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.294504+0000 mgr.y (mgr.25069) 418 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.302472+0000 mgr.y (mgr.25069) 419 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.304794+0000 mgr.y (mgr.25069) 420 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.313306+0000 mgr.y (mgr.25069) 421 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:08:34.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.321489+0000 mgr.y (mgr.25069) 422 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:08:34.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.324189+0000 mgr.y (mgr.25069) 423 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:08:34.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.326882+0000 mgr.y (mgr.25069) 424 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:08:34.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.329690+0000 mgr.y (mgr.25069) 425 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:08:34.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.331176+0000 mgr.y (mgr.25069) 426 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:08:34.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cephadm 2024-02-10T09:08:32.386434+0000 mgr.y (mgr.25069) 427 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:08:34.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:33.192599+0000 mgr.y (mgr.25069) 428 : audit [DBG] from='client.54699 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:34.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.274466+0000 mgr.y (mgr.25069) 415 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-10T09:08:34.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.281397+0000 mgr.y (mgr.25069) 416 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-10T09:08:34.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.288054+0000 mgr.y (mgr.25069) 417 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.294504+0000 mgr.y (mgr.25069) 418 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.302472+0000 mgr.y (mgr.25069) 419 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.304794+0000 mgr.y (mgr.25069) 420 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.313306+0000 mgr.y (mgr.25069) 421 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.321489+0000 mgr.y (mgr.25069) 422 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.324189+0000 mgr.y (mgr.25069) 423 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-02-10T09:08:34.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.326882+0000 mgr.y (mgr.25069) 424 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-02-10T09:08:34.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.329690+0000 mgr.y (mgr.25069) 425 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-02-10T09:08:34.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.331176+0000 mgr.y (mgr.25069) 426 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-10T09:08:34.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cephadm 2024-02-10T09:08:32.386434+0000 mgr.y (mgr.25069) 427 : cephadm [INF] Upgrade: Complete! 2024-02-10T09:08:34.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:33.192599+0000 mgr.y (mgr.25069) 428 : audit [DBG] from='client.54699 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:35.428 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:33.503439+0000 mgr.y (mgr.25069) 429 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:35.428 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:35 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:33.503439+0000 mgr.y (mgr.25069) 429 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:35.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:33.503439+0000 mgr.y (mgr.25069) 429 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (8m) 36s ago 32m 23.4M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (8m) 35s ago 31m 57.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (9m) 35s ago 35m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (19m) 36s ago 37m 430M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (7m) 36s ago 37m 125M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:08:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (7m) 35s ago 35m 75.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (6m) 36s ago 36m 73.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (9m) 36s ago 32m 20.0M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (9m) 35s ago 32m 22.8M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (5m) 36s ago 35m 45.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (5m) 36s ago 35m 45.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (4m) 36s ago 34m 44.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (3m) 36s ago 34m 47.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:08:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (3m) 35s ago 34m 44.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (2m) 35s ago 33m 42.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (2m) 35s ago 33m 43.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc c4fd746dfb98 2024-02-10T09:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (96s) 35s ago 33m 42.2M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 660a4a57cca9 2024-02-10T09:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (9m) 35s ago 32m 65.3M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (44s) 36s ago 30m 38.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc bc07d31cf6b9 2024-02-10T09:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (39s) 35s ago 30m 38.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc 78726f4517ba 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.865174+0000 mon.b (mon.2) 552 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.865930+0000 mon.b (mon.2) 553 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.866327+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.866699+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.867073+0000 mon.b (mon.2) 556 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.867420+0000 mon.b (mon.2) 557 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.869244+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.869745+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.870097+0000 mon.b (mon.2) 560 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.870426+0000 mon.b (mon.2) 561 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.870750+0000 mon.b (mon.2) 562 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.865174+0000 mon.b (mon.2) 552 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.865930+0000 mon.b (mon.2) 553 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.866327+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.866699+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.867073+0000 mon.b (mon.2) 556 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.867420+0000 mon.b (mon.2) 557 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.869244+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.869745+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.870097+0000 mon.b (mon.2) 560 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.870426+0000 mon.b (mon.2) 561 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.510 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.870750+0000 mon.b (mon.2) 562 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.865174+0000 mon.b (mon.2) 552 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.865930+0000 mon.b (mon.2) 553 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.866327+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.866699+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.867073+0000 mon.b (mon.2) 556 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.867420+0000 mon.b (mon.2) 557 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.869244+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:08:36.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.869745+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.870097+0000 mon.b (mon.2) 560 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.870426+0000 mon.b (mon.2) 561 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:36.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.870750+0000 mon.b (mon.2) 562 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:08:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:35.504202+0000 mgr.y (mgr.25069) 430 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:35.863023+0000 mgr.y (mgr.25069) 431 : audit [DBG] from='client.54705 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:37.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:36.833756+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:35.504202+0000 mgr.y (mgr.25069) 430 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:35.863023+0000 mgr.y (mgr.25069) 431 : audit [DBG] from='client.54705 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:37.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:37 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:36.833756+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:35.504202+0000 mgr.y (mgr.25069) 430 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:35.863023+0000 mgr.y (mgr.25069) 431 : audit [DBG] from='client.54705 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:08:37.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:37 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:36.833756+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:08:38.508 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:08:38.508 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:08:38.508 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:08:38.508 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 8 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 15 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:08:38.509 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:08:39.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-10T09:08:39.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:37.504723+0000 mgr.y (mgr.25069) 432 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:39.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:38.508500+0000 mon.c (mon.1) 18 : audit [DBG] from='client.64648 172.21.15.40:0/4003027400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:39.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:37.504723+0000 mgr.y (mgr.25069) 432 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:39.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:38.508500+0000 mon.c (mon.1) 18 : audit [DBG] from='client.64648 172.21.15.40:0/4003027400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:37.504723+0000 mgr.y (mgr.25069) 432 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:39.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:38.508500+0000 mon.c (mon.1) 18 : audit [DBG] from='client.64648 172.21.15.40:0/4003027400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:08:40.917 INFO:teuthology.orchestra.run.smithi040.stdout:wait for servicemap items w/ changing names to refresh 2024-02-10T09:08:41.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 60' 2024-02-10T09:08:41.513 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:39.505425+0000 mgr.y (mgr.25069) 433 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:41.514 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:39.505425+0000 mgr.y (mgr.25069) 433 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:41.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:39.505425+0000 mgr.y (mgr.25069) 433 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:42.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.433725+0000 mon.b (mon.2) 563 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:08:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.434002+0000 mon.b (mon.2) 564 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T09:08:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.434187+0000 mon.b (mon.2) 565 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.434324+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:08:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.434402+0000 mon.b (mon.2) 566 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.435045+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T09:08:42.533 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.435414+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.534 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:08:41.435799+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.433725+0000 mon.b (mon.2) 563 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:08:42.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.434002+0000 mon.b (mon.2) 564 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.434187+0000 mon.b (mon.2) 565 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.434324+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.434402+0000 mon.b (mon.2) 566 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.435045+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.435414+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:08:41.435799+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.433725+0000 mon.b (mon.2) 563 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.434002+0000 mon.b (mon.2) 564 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.434187+0000 mon.b (mon.2) 565 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.434324+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.434402+0000 mon.b (mon.2) 566 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.435045+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-10T09:08:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.435414+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-10T09:08:42.677 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:08:41.435799+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-10T09:08:43.427 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:41.506247+0000 mgr.y (mgr.25069) 434 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:43.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:43 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:41.506247+0000 mgr.y (mgr.25069) 434 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:43.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:41.506247+0000 mgr.y (mgr.25069) 434 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:45.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:43.506801+0000 mgr.y (mgr.25069) 435 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:45.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:43.506801+0000 mgr.y (mgr.25069) 435 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:45.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:43.506801+0000 mgr.y (mgr.25069) 435 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:46.532 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:45.507480+0000 mgr.y (mgr.25069) 436 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:46.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:45.507480+0000 mgr.y (mgr.25069) 436 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:46.676 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:45.507480+0000 mgr.y (mgr.25069) 436 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:47.508099+0000 mgr.y (mgr.25069) 437 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:49.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:47.508099+0000 mgr.y (mgr.25069) 437 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:47.508099+0000 mgr.y (mgr.25069) 437 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:51.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:49.508822+0000 mgr.y (mgr.25069) 438 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:49.508822+0000 mgr.y (mgr.25069) 438 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:51.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:49.508822+0000 mgr.y (mgr.25069) 438 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:53.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:51.509336+0000 mgr.y (mgr.25069) 439 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:53.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:51.509336+0000 mgr.y (mgr.25069) 439 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:51.509336+0000 mgr.y (mgr.25069) 439 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:55.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:53.510001+0000 mgr.y (mgr.25069) 440 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:55.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:53.510001+0000 mgr.y (mgr.25069) 440 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:53.510001+0000 mgr.y (mgr.25069) 440 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:57.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:55.510752+0000 mgr.y (mgr.25069) 441 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:57.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:55.510752+0000 mgr.y (mgr.25069) 441 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:55.510752+0000 mgr.y (mgr.25069) 441 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:59.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:08:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:57.511276+0000 mgr.y (mgr.25069) 442 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:59.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:08:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:57.511276+0000 mgr.y (mgr.25069) 442 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:08:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:08:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:57.511276+0000 mgr.y (mgr.25069) 442 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:01.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:08:59.512046+0000 mgr.y (mgr.25069) 443 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:01.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:08:59.512046+0000 mgr.y (mgr.25069) 443 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:08:59.512046+0000 mgr.y (mgr.25069) 443 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:03.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:01.512753+0000 mgr.y (mgr.25069) 444 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:03.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:01.512753+0000 mgr.y (mgr.25069) 444 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:01.512753+0000 mgr.y (mgr.25069) 444 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:05.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:03.513313+0000 mgr.y (mgr.25069) 445 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:05.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:03.513313+0000 mgr.y (mgr.25069) 445 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:03.513313+0000 mgr.y (mgr.25069) 445 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:07.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:05.513928+0000 mgr.y (mgr.25069) 446 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:07.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:05.513928+0000 mgr.y (mgr.25069) 446 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:07.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:05.513928+0000 mgr.y (mgr.25069) 446 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:09.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:07.514507+0000 mgr.y (mgr.25069) 447 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:09.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:07.514507+0000 mgr.y (mgr.25069) 447 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:09.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:07.514507+0000 mgr.y (mgr.25069) 447 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:11.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:09.515139+0000 mgr.y (mgr.25069) 448 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:11.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:10 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:09.515139+0000 mgr.y (mgr.25069) 448 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:11.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:09.515139+0000 mgr.y (mgr.25069) 448 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:13.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:11.515701+0000 mgr.y (mgr.25069) 449 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:13.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:12 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:11.515701+0000 mgr.y (mgr.25069) 449 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:13.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:12 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:11.515701+0000 mgr.y (mgr.25069) 449 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:15.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:13.516262+0000 mgr.y (mgr.25069) 450 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:15.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:14 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:13.516262+0000 mgr.y (mgr.25069) 450 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:15.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:14 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:13.516262+0000 mgr.y (mgr.25069) 450 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:17.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:15.516806+0000 mgr.y (mgr.25069) 451 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:17.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:16 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:15.516806+0000 mgr.y (mgr.25069) 451 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:17.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:16 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:15.516806+0000 mgr.y (mgr.25069) 451 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:19.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:17.517472+0000 mgr.y (mgr.25069) 452 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:19.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:18 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:17.517472+0000 mgr.y (mgr.25069) 452 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:19.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:18 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:17.517472+0000 mgr.y (mgr.25069) 452 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:21.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:19.518146+0000 mgr.y (mgr.25069) 453 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:21.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:20 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:19.518146+0000 mgr.y (mgr.25069) 453 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:21.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:20 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:19.518146+0000 mgr.y (mgr.25069) 453 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:23.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:21.518708+0000 mgr.y (mgr.25069) 454 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:23.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:22 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:21.518708+0000 mgr.y (mgr.25069) 454 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:23.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:22 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:21.518708+0000 mgr.y (mgr.25069) 454 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:25.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:23.519188+0000 mgr.y (mgr.25069) 455 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:25.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:24 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:23.519188+0000 mgr.y (mgr.25069) 455 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:25.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:24 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:23.519188+0000 mgr.y (mgr.25069) 455 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:27.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:25.520006+0000 mgr.y (mgr.25069) 456 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:27.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:26 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:25.520006+0000 mgr.y (mgr.25069) 456 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:27.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:26 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:25.520006+0000 mgr.y (mgr.25069) 456 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:29.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:27.520610+0000 mgr.y (mgr.25069) 457 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:29.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:27.520610+0000 mgr.y (mgr.25069) 457 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:29.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:28 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:27.520610+0000 mgr.y (mgr.25069) 457 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:31.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:29.521311+0000 mgr.y (mgr.25069) 458 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:31.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:30 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:29.521311+0000 mgr.y (mgr.25069) 458 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:31.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:30 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:29.521311+0000 mgr.y (mgr.25069) 458 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:33.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:31.521945+0000 mgr.y (mgr.25069) 459 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:33.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:32.709827+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:09:33.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:31.521945+0000 mgr.y (mgr.25069) 459 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:33.177 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:32 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:32.709827+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:09:33.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:31.521945+0000 mgr.y (mgr.25069) 459 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:33.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:32 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:32.709827+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.25069 ' entity='mgr.y' 2024-02-10T09:09:35.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:33.522500+0000 mgr.y (mgr.25069) 460 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:35.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:34 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:33.522500+0000 mgr.y (mgr.25069) 460 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:35.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:34 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:33.522500+0000 mgr.y (mgr.25069) 460 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:37.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:35.523191+0000 mgr.y (mgr.25069) 461 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:37.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:35.523191+0000 mgr.y (mgr.25069) 461 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:37.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:36 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:35.523191+0000 mgr.y (mgr.25069) 461 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:39.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:37.523635+0000 mgr.y (mgr.25069) 462 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:39.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:37.523635+0000 mgr.y (mgr.25069) 462 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:39.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:37.523635+0000 mgr.y (mgr.25069) 462 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:41.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:39.524188+0000 mgr.y (mgr.25069) 463 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:41.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:39.524188+0000 mgr.y (mgr.25069) 463 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:41.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:39.524188+0000 mgr.y (mgr.25069) 463 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.438079+0000 mon.b (mon.2) 567 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T09:09:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.438396+0000 mon.b (mon.2) 568 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.438669+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T09:09:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.438684+0000 mon.b (mon.2) 569 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T09:09:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.439026+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.439053+0000 mon.b (mon.2) 570 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.439415+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T09:09:42.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:41.439773+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.438079+0000 mon.b (mon.2) 567 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.438396+0000 mon.b (mon.2) 568 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.438669+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.438684+0000 mon.b (mon.2) 569 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.439026+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.439053+0000 mon.b (mon.2) 570 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.439415+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:41.439773+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.438079+0000 mon.b (mon.2) 567 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.438396+0000 mon.b (mon.2) 568 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.438669+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-10T09:09:42.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.438684+0000 mon.b (mon.2) 569 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T09:09:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.439026+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.439053+0000 mon.b (mon.2) 570 : audit [INF] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:09:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.439415+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-10T09:09:42.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:41 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:41.439773+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.25069 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2024-02-10T09:09:43.208 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:41.524861+0000 mgr.y (mgr.25069) 464 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:43.209 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:42 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:41.524861+0000 mgr.y (mgr.25069) 464 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:43.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:41.524861+0000 mgr.y (mgr.25069) 464 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:43.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-10T09:09:45.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:43.525420+0000 mgr.y (mgr.25069) 465 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:45.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:44 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:43.525420+0000 mgr.y (mgr.25069) 465 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:45.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:43.525420+0000 mgr.y (mgr.25069) 465 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:alertmanager.a smithi040 running (10m) 106s ago 33m 23.4M - 0.23.0 ba2b418f427c ea79f9a9c57e 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:grafana.a smithi145 running (9m) 105s ago 33m 57.8M - 8.3.5 dad864ee21e9 c95486c769a1 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi145 *:8443 running (10m) 105s ago 36m 385M - 16.2.14-521-g0e714d9a 1fbc92c859dc 80326d960b75 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi040 *:8443 running (20m) 106s ago 38m 430M - 16.2.14-521-g0e714d9a 1fbc92c859dc 396268bc9a9f 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (8m) 106s ago 38m 125M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 77d7b1c126b5 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi145 running (9m) 105s ago 37m 75.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 61b9d8dce82b 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi040 running (7m) 106s ago 37m 73.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc c673a83ed8be 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.a smithi040 running (10m) 106s ago 33m 20.0M - 1.3.1 1dbe0e931976 55e529403579 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:node-exporter.b smithi145 running (10m) 105s ago 33m 22.8M - 1.3.1 1dbe0e931976 3bf2c54c82c9 2024-02-10T09:09:45.921 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (6m) 106s ago 36m 45.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d22eb04aacbc 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi040 running (6m) 106s ago 36m 45.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4893de65913a 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi040 running (5m) 106s ago 35m 44.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc be51c6565b74 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (4m) 106s ago 35m 47.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 1fe1120f3817 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi145 running (4m) 105s ago 35m 44.3M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 6d72329fd65e 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi145 running (3m) 105s ago 34m 42.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 0c920d7faaee 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi145 running (3m) 105s ago 34m 43.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc c4fd746dfb98 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi145 running (2m) 105s ago 34m 42.2M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 660a4a57cca9 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:prometheus.a smithi145 running (10m) 105s ago 33m 65.3M - 2.33.4 514e6a882f6e b6b7f64e78cb 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi040.skjeib smithi040 running (114s) 106s ago 31m 38.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc bc07d31cf6b9 2024-02-10T09:09:45.922 INFO:teuthology.orchestra.run.smithi040.stdout:rgw.r.z.smithi145.uizklq smithi145 running (109s) 105s ago 31m 38.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc 78726f4517ba 2024-02-10T09:09:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.909682+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.910569+0000 mon.b (mon.2) 572 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.910971+0000 mon.b (mon.2) 573 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.911358+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.911786+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.912134+0000 mon.b (mon.2) 576 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.913918+0000 mon.b (mon.2) 577 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.914340+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.914743+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.915087+0000 mon.b (mon.2) 580 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.915441+0000 mon.b (mon.2) 581 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.909682+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.910569+0000 mon.b (mon.2) 572 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.910971+0000 mon.b (mon.2) 573 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.911358+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.911786+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.912134+0000 mon.b (mon.2) 576 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.913918+0000 mon.b (mon.2) 577 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.914340+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.914743+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.915087+0000 mon.b (mon.2) 580 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.915441+0000 mon.b (mon.2) 581 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.909682+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.910569+0000 mon.b (mon.2) 572 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.910971+0000 mon.b (mon.2) 573 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.911358+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.911786+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.912134+0000 mon.b (mon.2) 576 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.913918+0000 mon.b (mon.2) 577 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.914340+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.914743+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.915087+0000 mon.b (mon.2) 580 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.427 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:45 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.915441+0000 mon.b (mon.2) 581 : audit [DBG] from='mgr.25069 172.21.15.40:0/973971994' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-10T09:09:46.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-10T09:09:47.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:45.526209+0000 mgr.y (mgr.25069) 466 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:47.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:45.907577+0000 mgr.y (mgr.25069) 467 : audit [DBG] from='client.54717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:09:47.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:45.526209+0000 mgr.y (mgr.25069) 466 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:47.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:46 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:45.907577+0000 mgr.y (mgr.25069) 467 : audit [DBG] from='client.54717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:09:47.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:45.526209+0000 mgr.y (mgr.25069) 466 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:47.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:45.907577+0000 mgr.y (mgr.25069) 467 : audit [DBG] from='client.54717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 8 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": {}, 2024-02-10T09:09:48.575 INFO:teuthology.orchestra.run.smithi040.stdout: "rgw": { 2024-02-10T09:09:48.576 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-10T09:09:48.579 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-02-10T09:09:48.579 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2024-02-10T09:09:48.579 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 15 2024-02-10T09:09:48.579 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-02-10T09:09:48.579 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:09:49.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:47.526682+0000 mgr.y (mgr.25069) 468 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:49.175 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:48.574371+0000 mon.c (mon.1) 19 : audit [DBG] from='client.64660 172.21.15.40:0/3830759293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:47.526682+0000 mgr.y (mgr.25069) 468 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:49.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:48 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:48.574371+0000 mon.c (mon.1) 19 : audit [DBG] from='client.64660 172.21.15.40:0/3830759293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:49.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-10T09:09:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:47.526682+0000 mgr.y (mgr.25069) 468 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:49.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:48.574371+0000 mon.c (mon.1) 19 : audit [DBG] from='client.64660 172.21.15.40:0/3830759293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:51.176 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:49.527198+0000 mgr.y (mgr.25069) 469 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:51.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:50 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:49.527198+0000 mgr.y (mgr.25069) 469 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:51.266 INFO:teuthology.orchestra.run.smithi040.stdout:true 2024-02-10T09:09:51.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:49.527198+0000 mgr.y (mgr.25069) 469 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:51.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-10T09:09:52.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:51.255465+0000 mon.c (mon.1) 20 : audit [DBG] from='client.54729 172.21.15.40:0/1152171453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:52.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:51 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:51.255465+0000 mon.c (mon.1) 20 : audit [DBG] from='client.54729 172.21.15.40:0/1152171453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:52.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:51.255465+0000 mon.c (mon.1) 20 : audit [DBG] from='client.54729 172.21.15.40:0/1152171453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:53.136 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:51.527608+0000 mgr.y (mgr.25069) 470 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:53.136 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:52 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:51.527608+0000 mgr.y (mgr.25069) 470 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:53.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:51.527608+0000 mgr.y (mgr.25069) 470 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:53.895 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-10T09:09:54.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:53.884629+0000 mon.a (mon.0) 817 : audit [DBG] from='client.64672 172.21.15.40:0/1196990073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:54.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:53 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:53.884629+0000 mon.a (mon.0) 817 : audit [DBG] from='client.64672 172.21.15.40:0/1196990073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:54.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:53.884629+0000 mon.a (mon.0) 817 : audit [DBG] from='client.64672 172.21.15.40:0/1196990073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-10T09:09:54.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-02-10T09:09:55.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:53.528028+0000 mgr.y (mgr.25069) 471 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:55.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:54 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:53.528028+0000 mgr.y (mgr.25069) 471 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:55.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:53.528028+0000 mgr.y (mgr.25069) 471 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:56.595 INFO:teuthology.orchestra.run.smithi040.stdout:osd 8 117s ago - 2024-02-10T09:09:57.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:55.528643+0000 mgr.y (mgr.25069) 472 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:57.390 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:55.528643+0000 mgr.y (mgr.25069) 472 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:57.390 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:56 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:55.528643+0000 mgr.y (mgr.25069) 472 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:57.403 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-10T09:09:57.414 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T09:09:57.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- bash -c 'ceph orch upgrade ls' 2024-02-10T09:09:58.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:56.579947+0000 mgr.y (mgr.25069) 473 : audit [DBG] from='client.54741 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:09:58.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:57 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:56.579947+0000 mgr.y (mgr.25069) 473 : audit [DBG] from='client.54741 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:09:58.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:56.579947+0000 mgr.y (mgr.25069) 473 : audit [DBG] from='client.54741 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:09:59.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:09:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:57.529028+0000 mgr.y (mgr.25069) 474 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:59.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:09:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:57.529028+0000 mgr.y (mgr.25069) 474 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:59.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:09:58 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:57.529028+0000 mgr.y (mgr.25069) 474 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:09:59.988 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "image": "quay.io/ceph/ceph", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "registry": "quay.io", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "bare_image": "ceph/ceph", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "versions": [ 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "18.2.1", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "18.2.0", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "18.1.3", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "18.1.2", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "18.1.1", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "18.1.0", 2024-02-10T09:09:59.989 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.7", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.6", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.5", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.4", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.3", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.2", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.1", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.2.0", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "17.1.0", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.14", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.13", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.12", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.11", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.10", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.9", 2024-02-10T09:09:59.990 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.8", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.7", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.6", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.5", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.4", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.3", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.2", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.1", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.0", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.17", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.16", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.15", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.14", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.13", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.12", 2024-02-10T09:09:59.991 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.11", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.10", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.9", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.8", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.7", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.6", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.5", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.4", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.3", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.2", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.1", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "15.2.0", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.22", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.21", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.20", 2024-02-10T09:09:59.992 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.19", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.18", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.17", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.16", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.15", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.14", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.13", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.12", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.11", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.10", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.9", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.8", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.7", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.6", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.5", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.4", 2024-02-10T09:09:59.993 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.3", 2024-02-10T09:09:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.2", 2024-02-10T09:09:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.1", 2024-02-10T09:09:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: "14.2.0" 2024-02-10T09:09:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-02-10T09:09:59.994 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-02-10T09:10:00.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0' 2024-02-10T09:10:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:09:59.344449+0000 mgr.y (mgr.25069) 475 : audit [DBG] from='client.54747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:09:59.529635+0000 mgr.y (mgr.25069) 476 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:01.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:10:00.000145+0000 mon.a (mon.0) 818 : cluster [INF] overall HEALTH_OK 2024-02-10T09:10:01.425 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:09:59.344449+0000 mgr.y (mgr.25069) 475 : audit [DBG] from='client.54747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:01.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:09:59.529635+0000 mgr.y (mgr.25069) 476 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:01.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:10:00.000145+0000 mon.a (mon.0) 818 : cluster [INF] overall HEALTH_OK 2024-02-10T09:10:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:09:59.344449+0000 mgr.y (mgr.25069) 475 : audit [DBG] from='client.54747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:09:59.529635+0000 mgr.y (mgr.25069) 476 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:01.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:00 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:10:00.000145+0000 mon.a (mon.0) 818 : cluster [INF] overall HEALTH_OK 2024-02-10T09:10:03.160 INFO:teuthology.orchestra.run.smithi040.stdout: "16.2.0", 2024-02-10T09:10:03.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:10:01.530265+0000 mgr.y (mgr.25069) 477 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:03.426 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:10:01.530265+0000 mgr.y (mgr.25069) 477 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:03.426 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:02 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:10:01.530265+0000 mgr.y (mgr.25069) 477 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:03.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-02-10T09:10:04.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:10:02.630315+0000 mgr.y (mgr.25069) 478 : audit [DBG] from='client.54753 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:04.176 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:03 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:10:02.630315+0000 mgr.y (mgr.25069) 478 : audit [DBG] from='client.54753 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:04.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:10:02.630315+0000 mgr.y (mgr.25069) 478 : audit [DBG] from='client.54753 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:05.083 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:10:03.530844+0000 mgr.y (mgr.25069) 479 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:05.083 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:04 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:10:03.530844+0000 mgr.y (mgr.25069) 479 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:10:03.530844+0000 mgr.y (mgr.25069) 479 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:06.333 INFO:teuthology.orchestra.run.smithi040.stdout: "v16.2.2", 2024-02-10T09:10:06.333 INFO:teuthology.orchestra.run.smithi040.stdout: "v16.2.2-20210505", 2024-02-10T09:10:06.962 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-10T09:10:06.973 INFO:tasks.cephadm:Teardown begin 2024-02-10T09:10:06.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T09:10:07.009 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T09:10:07.048 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-10T09:10:07.048 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-10T09:10:07.070 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-10T09:10:07.109 INFO:tasks.cephadm:Stopping all daemons... 2024-02-10T09:10:07.109 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-10T09:10:07.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a 2024-02-10T09:10:07.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: cluster 2024-02-10T09:10:05.531346+0000 mgr.y (mgr.25069) 480 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:07.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: audit 2024-02-10T09:10:05.748473+0000 mgr.y (mgr.25069) 481 : audit [DBG] from='client.64696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:07.423 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: cluster 2024-02-10T09:10:05.531346+0000 mgr.y (mgr.25069) 480 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:07.423 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:06 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: audit 2024-02-10T09:10:05.748473+0000 mgr.y (mgr.25069) 481 : audit [DBG] from='client.64696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:07.424 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:07 smithi040 systemd[1]: Stopping Ceph mon.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:07.424 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:07 smithi040 bash[94940]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.a" found: no such container 2024-02-10T09:10:07.424 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: cluster 2024-02-10T09:10:05.531346+0000 mgr.y (mgr.25069) 480 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-10T09:10:07.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: audit 2024-02-10T09:10:05.748473+0000 mgr.y (mgr.25069) 481 : audit [DBG] from='client.64696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-10T09:10:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:10:07.422+0000 7fdb28399700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T09:10:07.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:07 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a[73749]: debug 2024-02-10T09:10:07.422+0000 7fdb28399700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-02-10T09:10:08.175 INFO:journalctl@ceph.mon.a.smithi040.stdout:Feb 10 09:10:07 smithi040 bash[94981]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-a 2024-02-10T09:10:08.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.a.service' 2024-02-10T09:10:08.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:08.370 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-10T09:10:08.370 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-02-10T09:10:08.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.c 2024-02-10T09:10:08.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:08 smithi040 systemd[1]: Stopping Ceph mon.c for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:08.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:08 smithi040 bash[95100]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.c" found: no such container 2024-02-10T09:10:08.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:10:08.666+0000 7f55f8496700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T09:10:08.669 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:08 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c[75132]: debug 2024-02-10T09:10:08.667+0000 7f55f8496700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-02-10T09:10:09.425 INFO:journalctl@ceph.mon.c.smithi040.stdout:Feb 10 09:10:09 smithi040 bash[95141]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-c 2024-02-10T09:10:09.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.c.service' 2024-02-10T09:10:09.639 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:09.640 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-02-10T09:10:09.640 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-10T09:10:09.640 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.b 2024-02-10T09:10:09.975 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:09 smithi145 systemd[1]: Stopping Ceph mon.b for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:09.975 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:09 smithi145 bash[72574]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon.b" found: no such container 2024-02-10T09:10:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:10:09.974+0000 7fd5bdcb6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-10T09:10:10.282 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b[60549]: debug 2024-02-10T09:10:09.974+0000 7fd5bdcb6700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-02-10T09:10:10.782 INFO:journalctl@ceph.mon.b.smithi145.stdout:Feb 10 09:10:10 smithi145 bash[72614]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mon-b 2024-02-10T09:10:10.918 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mon.b.service' 2024-02-10T09:10:10.966 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:10.967 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-10T09:10:10.967 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-10T09:10:10.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y 2024-02-10T09:10:11.280 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:10:11 smithi040 systemd[1]: Stopping Ceph mgr.y for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:11.281 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:10:11 smithi040 bash[95260]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.y" found: no such container 2024-02-10T09:10:11.281 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:10:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:10:11.279+0000 7f95c0709700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:11.281 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:10:11 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y[61574]: debug 2024-02-10T09:10:11.279+0000 7f95c0709700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-10T09:10:11.925 INFO:journalctl@ceph.mgr.y.smithi040.stdout:Feb 10 09:10:11 smithi040 bash[95300]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-y 2024-02-10T09:10:12.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.y.service' 2024-02-10T09:10:12.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:12.128 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-10T09:10:12.129 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-10T09:10:12.129 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x 2024-02-10T09:10:12.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:10:12 smithi145 systemd[1]: Stopping Ceph mgr.x for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:12.532 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:10:12 smithi145 bash[72735]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr.x" found: no such container 2024-02-10T09:10:13.032 INFO:journalctl@ceph.mgr.x.smithi145.stdout:Feb 10 09:10:12 smithi145 bash[72774]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-mgr-x 2024-02-10T09:10:13.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@mgr.x.service' 2024-02-10T09:10:13.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:13.317 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-10T09:10:13.317 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-10T09:10:13.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.0 2024-02-10T09:10:13.626 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:10:13 smithi040 systemd[1]: Stopping Ceph osd.0 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:13.627 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:10:13 smithi040 bash[95421]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.0" found: no such container 2024-02-10T09:10:13.925 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:10:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:10:13.625+0000 7fc88c30e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:13.925 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:10:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:10:13.625+0000 7fc88c30e700 -1 osd.0 106 *** Got signal Terminated *** 2024-02-10T09:10:13.925 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:10:13 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0[78887]: debug 2024-02-10T09:10:13.625+0000 7fc88c30e700 -1 osd.0 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:19.426 INFO:journalctl@ceph.osd.0.smithi040.stdout:Feb 10 09:10:19 smithi040 bash[95460]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-0 2024-02-10T09:10:20.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.0.service' 2024-02-10T09:10:20.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:20.699 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-10T09:10:20.699 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-10T09:10:20.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.1 2024-02-10T09:10:20.925 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:10:20 smithi040 systemd[1]: Stopping Ceph osd.1 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:20.925 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:10:20 smithi040 bash[95696]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.1" found: no such container 2024-02-10T09:10:21.425 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:10:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:10:21.035+0000 7ff60ad1c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:21.425 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:10:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:10:21.035+0000 7ff60ad1c700 -1 osd.1 106 *** Got signal Terminated *** 2024-02-10T09:10:21.426 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:10:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1[80672]: debug 2024-02-10T09:10:21.035+0000 7ff60ad1c700 -1 osd.1 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:26.676 INFO:journalctl@ceph.osd.1.smithi040.stdout:Feb 10 09:10:26 smithi040 bash[95737]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-1 2024-02-10T09:10:28.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.1.service' 2024-02-10T09:10:28.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:28.285 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-10T09:10:28.285 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-10T09:10:28.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.2 2024-02-10T09:10:28.606 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:28 smithi040 systemd[1]: Stopping Ceph osd.2 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:28.606 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:28 smithi040 bash[95980]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.2" found: no such container 2024-02-10T09:10:28.925 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:10:28.604+0000 7fe2db03d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:28.925 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:10:28.604+0000 7fe2db03d700 -1 osd.2 106 *** Got signal Terminated *** 2024-02-10T09:10:28.926 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:28 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2[83573]: debug 2024-02-10T09:10:28.604+0000 7fe2db03d700 -1 osd.2 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:34.425 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:34 smithi040 bash[96022]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-2 2024-02-10T09:10:35.717 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:35 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.2.service: Succeeded. 2024-02-10T09:10:35.717 INFO:journalctl@ceph.osd.2.smithi040.stdout:Feb 10 09:10:35 smithi040 systemd[1]: Stopped Ceph osd.2 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:10:35.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.2.service' 2024-02-10T09:10:35.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:35.760 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-10T09:10:35.760 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-10T09:10:35.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.3 2024-02-10T09:10:36.082 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:35 smithi040 systemd[1]: Stopping Ceph osd.3 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:36.082 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:35 smithi040 bash[96258]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.3" found: no such container 2024-02-10T09:10:36.427 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:10:36.080+0000 7f040832c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:36.427 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:10:36.080+0000 7f040832c700 -1 osd.3 106 *** Got signal Terminated *** 2024-02-10T09:10:36.427 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:36 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:10:36.080+0000 7f040832c700 -1 osd.3 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:39.175 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:38 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:10:38.891+0000 7f04042a7700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:15.907682+0000 front 2024-02-10T09:10:15.907761+0000 (oldest deadline 2024-02-10T09:10:38.807855+0000) 2024-02-10T09:10:39.282 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:38 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:38.879+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:40.216 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:39 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:39.909+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:40.216 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:40.104+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:40.425 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:39 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:10:39.934+0000 7f04042a7700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:15.907682+0000 front 2024-02-10T09:10:15.907761+0000 (oldest deadline 2024-02-10T09:10:38.807855+0000) 2024-02-10T09:10:40.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:40.215+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:41.175 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:40 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3[87602]: debug 2024-02-10T09:10:40.923+0000 7f04042a7700 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:15.907682+0000 front 2024-02-10T09:10:15.907761+0000 (oldest deadline 2024-02-10T09:10:38.807855+0000) 2024-02-10T09:10:41.248 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:40 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:40.890+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:41.248 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:41.091+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:41.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:41.246+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:41.675 INFO:journalctl@ceph.osd.3.smithi040.stdout:Feb 10 09:10:41 smithi040 bash[96298]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-3 2024-02-10T09:10:42.212 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:42.052+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:42.213 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:41 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:41.868+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:42.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:42.211+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:43.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.3.service' 2024-02-10T09:10:43.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:43.121 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-10T09:10:43.121 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-10T09:10:43.121 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.4 2024-02-10T09:10:43.154 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:42 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:42.836+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:43.155 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:43.012+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:43.437 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:43.172+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:43.438 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:43 smithi145 systemd[1]: Stopping Ceph osd.4 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:43.438 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:43 smithi145 bash[72899]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.4" found: no such container 2024-02-10T09:10:43.782 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:43.436+0000 7fa5187a6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:43.782 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:43.436+0000 7fa5187a6700 -1 osd.4 106 *** Got signal Terminated *** 2024-02-10T09:10:43.782 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:43.436+0000 7fa5187a6700 -1 osd.4 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:44.172 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:44.171+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:44.172 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:43 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:43.822+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:44.173 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:44.039+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:45.008 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:44.870+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:45.008 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:44 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:44.653+0000 7fa515f24700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:18.055246+0000 front 2024-02-10T09:10:18.055231+0000 (oldest deadline 2024-02-10T09:10:43.955088+0000) 2024-02-10T09:10:45.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:45.198+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:45.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:45.007+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:46.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:45.652+0000 7fa515f24700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:18.055246+0000 front 2024-02-10T09:10:18.055231+0000 (oldest deadline 2024-02-10T09:10:43.955088+0000) 2024-02-10T09:10:46.033 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:45 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:45.863+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:46.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:46.167+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:46.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:46.040+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:47.013 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:46.817+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:47.013 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:46 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:46.680+0000 7fa515f24700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:18.055246+0000 front 2024-02-10T09:10:18.055231+0000 (oldest deadline 2024-02-10T09:10:43.955088+0000) 2024-02-10T09:10:47.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:47.146+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:47.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:47.012+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:48.005 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:47.848+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:48.006 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:47.724+0000 7fa515f24700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:18.055246+0000 front 2024-02-10T09:10:18.055231+0000 (oldest deadline 2024-02-10T09:10:43.955088+0000) 2024-02-10T09:10:48.006 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:47 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4[63805]: debug 2024-02-10T09:10:47.724+0000 7fa515f24700 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.656127+0000 front 2024-02-10T09:10:25.656148+0000 (oldest deadline 2024-02-10T09:10:47.356012+0000) 2024-02-10T09:10:48.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:48.108+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:48.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:48.108+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:48.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:48.005+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:48.283 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:48.005+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:49.032 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:48 smithi145 bash[72940]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-4 2024-02-10T09:10:49.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:48 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:48.819+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:49.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:49.107+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:49.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:49.107+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:49.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:49.033+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:49.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:49.033+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:49.957 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:49 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:49.775+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:50.259 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:50.082+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:50.259 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:50.082+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:50.259 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:50.082+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:50.259 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:50.082+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:50.511 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.4.service' 2024-02-10T09:10:50.532 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:50 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.4.service: Succeeded. 2024-02-10T09:10:50.532 INFO:journalctl@ceph.osd.4.smithi145.stdout:Feb 10 09:10:50 smithi145 systemd[1]: Stopped Ceph osd.4 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:10:50.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:50.575 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-10T09:10:50.575 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-10T09:10:50.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.5 2024-02-10T09:10:50.931 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 systemd[1]: Stopping Ceph osd.5 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:50.931 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 bash[73183]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.5" found: no such container 2024-02-10T09:10:50.932 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:50.744+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:50.932 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:50.744+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:51.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:51.047+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:51.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:51.047+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:51.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:50.930+0000 7f6534447700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:51.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:50.930+0000 7f6534447700 -1 osd.5 106 *** Got signal Terminated *** 2024-02-10T09:10:51.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:50 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:50.930+0000 7f6534447700 -1 osd.5 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:51.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:51.055+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:51.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:51.055+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:52.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:51.712+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:52.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:51 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:51.712+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:52.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:52.053+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:52.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:52.053+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:52.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:52.050+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:52.533 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:52.050+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:53.018 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:52.695+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:53.018 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:52 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:52.695+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:53.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:53.018+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:53.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:53.018+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:53.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:53.027+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:53.283 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:53.027+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:54.018 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:53.702+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:54.018 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:53 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:53.702+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:54.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:54.018+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:54.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:54.018+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:54.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:54.070+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:54.282 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:54.070+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:55.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:54.688+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:55.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:54 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:54.688+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:55.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:55.048+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:55.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:55.048+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:55.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:55.113+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:14.537660+0000 front 2024-02-10T09:10:14.537783+0000 (oldest deadline 2024-02-10T09:10:39.837760+0000) 2024-02-10T09:10:55.532 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:55.113+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.738901+0000 front 2024-02-10T09:10:25.738979+0000 (oldest deadline 2024-02-10T09:10:47.438756+0000) 2024-02-10T09:10:55.533 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5[65459]: debug 2024-02-10T09:10:55.113+0000 7f65303c2700 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:29.739914+0000 front 2024-02-10T09:10:29.739884+0000 (oldest deadline 2024-02-10T09:10:54.439693+0000) 2024-02-10T09:10:56.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:55.663+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:56.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:55 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:55.663+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:56.411 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:56.038+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:56.411 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:56.038+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:56.782 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:56 smithi145 bash[73223]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-5 2024-02-10T09:10:56.783 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:56.657+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:56.783 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:56 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:56.657+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:57.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:57.054+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:57.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:57.054+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:57.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:57.054+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:10:57.843 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:57.678+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:57.843 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:57.678+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:57.843 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:57 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:57.678+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.725503+0000 front 2024-02-10T09:10:32.725571+0000 (oldest deadline 2024-02-10T09:10:56.825468+0000) 2024-02-10T09:10:58.094 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:58 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.5.service: Succeeded. 2024-02-10T09:10:58.094 INFO:journalctl@ceph.osd.5.smithi145.stdout:Feb 10 09:10:58 smithi145 systemd[1]: Stopped Ceph osd.5 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:10:58.094 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:58.010+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:58.094 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:58.010+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:58.094 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:58.010+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:10:58.095 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.5.service' 2024-02-10T09:10:58.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:10:58.136 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-10T09:10:58.136 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-10T09:10:58.136 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.6 2024-02-10T09:10:58.474 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 systemd[1]: Stopping Ceph osd.6 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:10:58.474 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 bash[73461]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.6" found: no such container 2024-02-10T09:10:58.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:58.474+0000 7f28bfd30700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:10:58.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:58.474+0000 7f28bfd30700 -1 osd.6 106 *** Got signal Terminated *** 2024-02-10T09:10:58.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:58.474+0000 7f28bfd30700 -1 osd.6 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:10:58.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:58.647+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:10:58.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:58.647+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:10:58.782 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:58 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:58.647+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.725503+0000 front 2024-02-10T09:10:32.725571+0000 (oldest deadline 2024-02-10T09:10:56.825468+0000) 2024-02-10T09:10:59.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:59.012+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:10:59.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:59.012+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:10:59.282 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:10:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:10:59.012+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:00.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:59.668+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:11:00.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:59.668+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:11:00.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:10:59 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:10:59.668+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.725503+0000 front 2024-02-10T09:10:32.725571+0000 (oldest deadline 2024-02-10T09:10:56.825468+0000) 2024-02-10T09:11:00.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:00.037+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:00.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:00.037+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:00.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:00.037+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:01.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:00.645+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:11:01.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:00.645+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:11:01.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:00 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:00.645+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.725503+0000 front 2024-02-10T09:10:32.725571+0000 (oldest deadline 2024-02-10T09:10:56.825468+0000) 2024-02-10T09:11:01.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:01.079+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:01.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:01.079+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:01.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:01.079+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:02.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:01.654+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:11:02.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:01.654+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:11:02.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:01 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:01.654+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.725503+0000 front 2024-02-10T09:10:32.725571+0000 (oldest deadline 2024-02-10T09:10:56.825468+0000) 2024-02-10T09:11:02.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:02.074+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:02.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:02.074+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:02.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:02.074+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:03.032 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:02.615+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:17.023595+0000 front 2024-02-10T09:10:17.023479+0000 (oldest deadline 2024-02-10T09:10:38.723402+0000) 2024-02-10T09:11:03.033 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:02.615+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:25.724861+0000 front 2024-02-10T09:10:25.724820+0000 (oldest deadline 2024-02-10T09:10:49.824696+0000) 2024-02-10T09:11:03.033 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:02 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6[68436]: debug 2024-02-10T09:11:02.615+0000 7f28b8ca5700 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.725503+0000 front 2024-02-10T09:10:32.725571+0000 (oldest deadline 2024-02-10T09:10:56.825468+0000) 2024-02-10T09:11:03.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:03.104+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:03.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:03.104+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:03.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:03 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:03.104+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:04.147 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:03 smithi145 bash[73500]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-6 2024-02-10T09:11:04.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:04.146+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:04.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:04.146+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:04.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:04 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:04.146+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:05.429 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:05.111+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:05.429 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:05.111+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:05.429 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:05 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:05.111+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:05.664 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.6.service' 2024-02-10T09:11:05.691 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:05 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.6.service: Succeeded. 2024-02-10T09:11:05.691 INFO:journalctl@ceph.osd.6.smithi145.stdout:Feb 10 09:11:05 smithi145 systemd[1]: Stopped Ceph osd.6 for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:11:05.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:11:05.704 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-10T09:11:05.705 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-10T09:11:05.705 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.7 2024-02-10T09:11:06.032 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:05 smithi145 systemd[1]: Stopping Ceph osd.7 for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:11:06.032 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:05 smithi145 bash[73738]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd.7" found: no such container 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.050+0000 7f534b18f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.050+0000 7f534b18f700 -1 osd.7 106 *** Got signal Terminated *** 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.050+0000 7f534b18f700 -1 osd.7 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.090+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.090+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.090+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:06.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:06 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:06.090+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6830 osd.3 since back 2024-02-10T09:10:39.528060+0000 front 2024-02-10T09:10:39.528105+0000 (oldest deadline 2024-02-10T09:11:05.427877+0000) 2024-02-10T09:11:07.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:07.045+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:07.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:07.045+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:07.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:07.045+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:07.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:07 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:07.045+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6830 osd.3 since back 2024-02-10T09:10:39.528060+0000 front 2024-02-10T09:10:39.528105+0000 (oldest deadline 2024-02-10T09:11:05.427877+0000) 2024-02-10T09:11:08.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:08.088+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:08.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:08.088+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:08.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:08.088+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:08.533 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:08 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:08.088+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6830 osd.3 since back 2024-02-10T09:10:39.528060+0000 front 2024-02-10T09:10:39.528105+0000 (oldest deadline 2024-02-10T09:11:05.427877+0000) 2024-02-10T09:11:09.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:09.135+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:09.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:09.135+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:09.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:09.135+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:09.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:09 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:09.135+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6830 osd.3 since back 2024-02-10T09:10:39.528060+0000 front 2024-02-10T09:10:39.528105+0000 (oldest deadline 2024-02-10T09:11:05.427877+0000) 2024-02-10T09:11:10.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:10.166+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-02-10T09:10:16.224831+0000 front 2024-02-10T09:10:16.224837+0000 (oldest deadline 2024-02-10T09:10:39.724648+0000) 2024-02-10T09:11:10.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:10.166+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6814 osd.1 since back 2024-02-10T09:10:23.726393+0000 front 2024-02-10T09:10:23.726280+0000 (oldest deadline 2024-02-10T09:10:47.826140+0000) 2024-02-10T09:11:10.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:10.166+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6822 osd.2 since back 2024-02-10T09:10:32.527305+0000 front 2024-02-10T09:10:32.527328+0000 (oldest deadline 2024-02-10T09:10:56.627119+0000) 2024-02-10T09:11:10.532 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:10 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7[70087]: debug 2024-02-10T09:11:10.166+0000 7f534810c700 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.40:6830 osd.3 since back 2024-02-10T09:10:39.528060+0000 front 2024-02-10T09:10:39.528105+0000 (oldest deadline 2024-02-10T09:11:05.427877+0000) 2024-02-10T09:11:11.782 INFO:journalctl@ceph.osd.7.smithi145.stdout:Feb 10 09:11:11 smithi145 bash[73777]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-osd-7 2024-02-10T09:11:13.092 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@osd.7.service' 2024-02-10T09:11:13.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:11:13.132 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-10T09:11:13.132 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-10T09:11:13.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a 2024-02-10T09:11:13.470 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 systemd[1]: Stopping Ceph prometheus.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:11:13.470 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 bash[74016]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus.a" found: no such container 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-10T09:11:13.782 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-02-10T09:11:13.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-02-10T09:11:13.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-02-10T09:11:13.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-02-10T09:11:13.783 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a[58242]: ts=2024-02-10T09:11:13.469Z caller=main.go:1066 level=info msg="See you next time!" 2024-02-10T09:11:14.135 INFO:journalctl@ceph.prometheus.a.smithi145.stdout:Feb 10 09:11:13 smithi145 bash[74056]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-prometheus-a 2024-02-10T09:11:14.141 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@prometheus.a.service' 2024-02-10T09:11:14.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-10T09:11:14.176 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-10T09:11:14.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 --force --keep-logs 2024-02-10T09:11:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-10T09:11:14.317 INFO:teuthology.orchestra.run.smithi040.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-10T09:11:14.317 INFO:teuthology.orchestra.run.smithi040.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-10T09:11:14.318 INFO:teuthology.orchestra.run.smithi040.stderr: [--retry RETRY] 2024-02-10T09:11:14.318 INFO:teuthology.orchestra.run.smithi040.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-02-10T09:11:14.318 INFO:teuthology.orchestra.run.smithi040.stderr: ... 2024-02-10T09:11:14.318 INFO:teuthology.orchestra.run.smithi040.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-10T09:11:14.327 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-10T09:11:14.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 --force --keep-logs 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr: [--retry RETRY] 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr: ... 2024-02-10T09:11:14.448 INFO:teuthology.orchestra.run.smithi145.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-10T09:11:14.457 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-10T09:11:14.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T09:11:14.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-10T09:11:14.515 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-10T09:11:14.517 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/remote/ubuntu@smithi040.front.sepia.ceph.com/crash 2024-02-10T09:11:14.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/crash -- . 2024-02-10T09:11:14.572 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/remote/ubuntu@smithi145.front.sepia.ceph.com/crash 2024-02-10T09:11:14.573 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/crash -- . 2024-02-10T09:11:14.622 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-10T09:11:14.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | head -n 1 2024-02-10T09:11:14.654 INFO:teuthology.orchestra.run.smithi040.stdout:2024-02-10T08:32:45.832632+0000 mon.a (mon.0) 146 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-10T09:11:14.654 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-10T09:11:14.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[SEC\]' /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | head -n 1 2024-02-10T09:11:14.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]' /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | head -n 1 2024-02-10T09:11:14.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[WRN\]' /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | head -n 1 2024-02-10T09:11:14.863 INFO:teuthology.orchestra.run.smithi040.stdout:2024-02-10T08:32:45.832632+0000 mon.a (mon.0) 146 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-10T09:11:14.863 INFO:tasks.cephadm:Compressing logs... 2024-02-10T09:11:14.863 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T09:11:14.906 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-10T09:11:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-10T09:11:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:: No such file or directory 2024-02-10T09:11:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-volume.log 2024-02-10T09:11:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.2.log 2024-02-10T09:11:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mgr.y.log 2024-02-10T09:11:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-volume.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.audit.log 2024-02-10T09:11:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.cephadm.log 2024-02-10T09:11:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mgr.y.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.3.log 2024-02-10T09:11:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.cephadm.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.3.log: 91.8% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.cephadm.log.gz 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:: No such file or directory 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-client.rgw.r.z.smithi145.uizklq.log 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.6.log 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-volume.log 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-client.rgw.r.z.smithi145.uizklq.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.6.log: 72.6% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-client.rgw.r.z.smithi145.uizklq.log.gz 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.audit.log 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.cephadm.log 2024-02-10T09:11:14.935 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-volume.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.7.log 2024-02-10T09:11:14.936 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.cephadm.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.7.log: 85.4% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.cephadm.log.gz 2024-02-10T09:11:14.936 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mgr.x.log 2024-02-10T09:11:14.937 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.b.log 2024-02-10T09:11:14.937 INFO:teuthology.orchestra.run.smithi040.stderr: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-10T09:11:14.937 INFO:teuthology.orchestra.run.smithi040.stderr: 91.3% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-volume.log.gz 2024-02-10T09:11:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.0.log 2024-02-10T09:11:14.938 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-client.rgw.r.z.smithi040.skjeib.log 2024-02-10T09:11:14.939 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mgr.x.log: /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-10T09:11:14.939 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log 2024-02-10T09:11:14.940 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-volume.log.gz 2024-02-10T09:11:14.940 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.4.log 2024-02-10T09:11:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.a.log 2024-02-10T09:11:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-client.rgw.r.z.smithi040.skjeib.log: 72.5% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-client.rgw.r.z.smithi040.skjeib.log.gz 2024-02-10T09:11:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.c.log 2024-02-10T09:11:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.4.log: 89.0% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log.gz 2024-02-10T09:11:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.5.log 2024-02-10T09:11:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log 2024-02-10T09:11:14.958 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log: 93.9% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.log.gz 2024-02-10T09:11:14.958 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.1.log 2024-02-10T09:11:14.962 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.5.log: 94.9% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.audit.log.gz 2024-02-10T09:11:14.989 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.1.log: 96.1% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph.audit.log.gz 2024-02-10T09:11:15.037 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mgr.x.log.gz 2024-02-10T09:11:15.393 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mgr.y.log.gz 2024-02-10T09:11:15.946 INFO:teuthology.orchestra.run.smithi145.stderr: 92.9% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.b.log.gz 2024-02-10T09:11:15.972 INFO:teuthology.orchestra.run.smithi145.stderr: 92.9% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.6.log.gz 2024-02-10T09:11:16.078 INFO:teuthology.orchestra.run.smithi040.stderr: 93.0% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.2.log.gz 2024-02-10T09:11:16.149 INFO:teuthology.orchestra.run.smithi145.stderr: 93.6% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.7.log.gz 2024-02-10T09:11:16.187 INFO:teuthology.orchestra.run.smithi040.stderr: 93.2% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.0.log.gz 2024-02-10T09:11:16.207 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.c.log.gz 2024-02-10T09:11:16.501 INFO:teuthology.orchestra.run.smithi145.stderr: 93.1% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.5.log.gz 2024-02-10T09:11:16.639 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.1.log.gz 2024-02-10T09:11:16.697 INFO:teuthology.orchestra.run.smithi145.stderr: 93.3% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.4.log.gz 2024-02-10T09:11:16.698 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-02-10T09:11:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m1.775s 2024-02-10T09:11:16.698 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m6.431s 2024-02-10T09:11:16.699 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m0.271s 2024-02-10T09:11:16.827 INFO:teuthology.orchestra.run.smithi040.stderr: 93.2% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-osd.3.log.gz 2024-02-10T09:11:16.903 INFO:teuthology.orchestra.run.smithi040.stderr: 91.0% -- replaced with /var/log/ceph/a67cbc88-c7ee-11ee-95b8-87774f69a715/ceph-mon.a.log.gz 2024-02-10T09:11:16.905 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-02-10T09:11:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m1.984s 2024-02-10T09:11:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m9.436s 2024-02-10T09:11:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.304s 2024-02-10T09:11:16.906 INFO:tasks.cephadm:Archiving logs... 2024-02-10T09:11:16.906 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/remote/ubuntu@smithi040.front.sepia.ceph.com/log 2024-02-10T09:11:16.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T09:11:18.192 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/remote/ubuntu@smithi145.front.sepia.ceph.com/log 2024-02-10T09:11:18.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-10T09:11:19.119 INFO:tasks.cephadm:Removing cluster... 2024-02-10T09:11:19.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 --force 2024-02-10T09:11:20.175 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 09:11:20 smithi040 systemd[1]: Stopping Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:11:20.175 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 09:11:20 smithi040 bash[97005]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter.a" found: no such container 2024-02-10T09:11:20.925 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 09:11:20 smithi040 bash[97044]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-a 2024-02-10T09:11:20.925 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 09:11:20 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-10T09:11:21.398 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 09:11:21 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-10T09:11:21.398 INFO:journalctl@ceph.node-exporter.a.smithi040.stdout:Feb 10 09:11:21 smithi040 systemd[1]: Stopped Ceph node-exporter.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:11:21.398 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 09:11:21 smithi040 systemd[1]: Stopping Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:11:21.399 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 09:11:21 smithi040 bash[97144]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager.a" found: no such container 2024-02-10T09:11:21.671 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 09:11:21 smithi040 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a[70128]: level=info ts=2024-02-10T09:11:21.397Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-10T09:11:21.925 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 09:11:21 smithi040 bash[97185]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-alertmanager-a 2024-02-10T09:11:22.425 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 09:11:22 smithi040 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-10T09:11:22.426 INFO:journalctl@ceph.alertmanager.a.smithi040.stdout:Feb 10 09:11:22 smithi040 systemd[1]: Stopped Ceph alertmanager.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:11:33.646 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a67cbc88-c7ee-11ee-95b8-87774f69a715 --force 2024-02-10T09:11:34.783 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 09:11:34 smithi145 systemd[1]: Stopping Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:11:34.783 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 09:11:34 smithi145 bash[74517]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter.b" found: no such container 2024-02-10T09:11:35.429 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 09:11:35 smithi145 bash[74557]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-node-exporter-b 2024-02-10T09:11:35.782 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 09:11:35 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-10T09:11:35.782 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 09:11:35 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-10T09:11:35.782 INFO:journalctl@ceph.node-exporter.b.smithi145.stdout:Feb 10 09:11:35 smithi145 systemd[1]: Stopped Ceph node-exporter.b for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:11:35.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:11:35 smithi145 systemd[1]: Stopping Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715... 2024-02-10T09:11:35.783 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:11:35 smithi145 bash[74658]: Error: no container with name or ID "ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana.a" found: no such container 2024-02-10T09:11:36.213 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:11:35 smithi145 ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a[59422]: t=2024-02-10T09:11:35+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-10T09:11:36.532 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:11:36 smithi145 bash[74696]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715-grafana-a 2024-02-10T09:11:37.032 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:11:36 smithi145 systemd[1]: ceph-a67cbc88-c7ee-11ee-95b8-87774f69a715@grafana.a.service: Succeeded. 2024-02-10T09:11:37.032 INFO:journalctl@ceph.grafana.a.smithi145.stdout:Feb 10 09:11:36 smithi145 systemd[1]: Stopped Ceph grafana.a for a67cbc88-c7ee-11ee-95b8-87774f69a715. 2024-02-10T09:11:48.160 INFO:tasks.cephadm:Removing cephadm ... 2024-02-10T09:11:48.161 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-10T09:11:48.184 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-10T09:11:48.202 INFO:tasks.cephadm:Teardown complete 2024-02-10T09:11:48.203 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-10T09:11:48.218 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-10T09:11:48.218 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T09:11:48.227 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-10T09:11:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2024-02-10T09:11:48.250 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T09:11:48.250 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-02-10T09:11:48.250 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 97 +45us[ +44us] +/- 79ms 2024-02-10T09:11:48.250 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 +161us[ +159us] +/- 57ms 2024-02-10T09:11:48.250 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -322us[ -323us] +/- 91ms 2024-02-10T09:11:48.250 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T09:11:48.259 INFO:teuthology.orchestra.run.smithi145.stderr:bash: ntpq: command not found 2024-02-10T09:11:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-10T09:11:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-02-10T09:11:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 33 +57us[ +68us] +/- 80ms 2024-02-10T09:11:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 +178us[ +189us] +/- 57ms 2024-02-10T09:11:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 99 -262us[ -253us] +/- 90ms 2024-02-10T09:11:48.263 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-10T09:11:48.264 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-10T09:11:48.273 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-10T09:11:48.274 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-10T09:11:48.289 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T09:11:48.368 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-10T09:11:48.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T09:11:48.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T09:11:48.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-10T09:11:48.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T09:11:48.494 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-10T09:11:48.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-10T09:11:48.518 INFO:teuthology.task.internal:Duration was 2939.463303 seconds 2024-02-10T09:11:48.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-10T09:11:48.532 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-10T09:11:48.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T09:11:48.535 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-10T09:11:48.580 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T09:11:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-10T09:11:48.791 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-10T09:11:48.791 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-02-10T09:11:48.791 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T09:11:48.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-02-10T09:11:48.817 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-10T09:11:48.839 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-10T09:11:48.839 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T09:11:48.859 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-10T09:11:48.969 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-10T09:11:48.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T09:11:48.972 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-10T09:11:49.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-10T09:11:49.226 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-10T09:11:49.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T09:11:49.254 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-10T09:11:49.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-10T09:11:49.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T09:11:49.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-10T09:11:49.321 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-02-10T09:11:49.348 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-02-10T09:11:49.367 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T09:11:49.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T09:11:49.403 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-10T09:11:49.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-10T09:11:49.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-10T09:11:49.435 INFO:teuthology.task.internal:Transferring archived files... 2024-02-10T09:11:49.436 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/remote/smithi040 2024-02-10T09:11:49.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T09:11:49.497 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321/remote/smithi145 2024-02-10T09:11:49.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-10T09:11:49.547 INFO:teuthology.task.internal:Removing archive directory... 2024-02-10T09:11:49.548 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T09:11:49.550 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-10T09:11:49.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-10T09:11:49.610 INFO:teuthology.task.internal:Not uploading archives. 2024-02-10T09:11:49.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-10T09:11:49.731 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-10T09:11:49.731 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T09:11:49.734 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-10T09:11:49.750 INFO:teuthology.orchestra.run.smithi040.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 09:11 /home/ubuntu/cephtest 2024-02-10T09:11:49.752 INFO:teuthology.orchestra.run.smithi145.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 10 09:11 /home/ubuntu/cephtest 2024-02-10T09:11:49.753 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-10T09:11:49.763 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-10T09:11:49.794 INFO:teuthology.nuke:Checking targets against current locks 2024-02-10T09:11:49.824 DEBUG:teuthology.nuke:shortname: smithi040 2024-02-10T09:11:49.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T09:11:49.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 08:13:23.770656', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2//zw1hYkyCXHGSE7VHNTMsm6W9FRMxzNTim/XZiM9JTBIGnldn9QsvB5J2hWC0MBRcW+v6eJY+RPFEUv4g+A='} 2024-02-10T09:11:49.853 DEBUG:teuthology.nuke:shortname: smithi145 2024-02-10T09:11:49.854 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T09:11:49.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-09_21:34:44-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7555321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 08:13:23.772023', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFr0rbtpN9nLzi1lIqSEQtLZGH34NCf0pDT9OIBHg5Rl/aYaA0cXWLNaQdyxcSPTz1+PHh3WttUOVeUhpayxCwk='} 2024-02-10T09:11:49.909 INFO:teuthology.orchestra.console.smithi040:Power off 2024-02-10T09:11:49.909 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T09:11:49.935 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-02-10T09:11:49.935 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:11:49.949 INFO:teuthology.orchestra.console.smithi145:Power off 2024-02-10T09:11:49.950 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T09:11:49.958 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-02-10T09:11:49.972 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-02-10T09:11:49.972 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:11:49.997 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-10T09:11:53.959 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:11:53.998 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:11:54.069 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-02-10T09:11:54.106 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-10T09:11:58.072 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:11:58.107 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:11:58.182 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-02-10T09:11:58.216 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-10T09:12:02.187 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:12:02.218 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T09:12:02.298 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-02-10T09:12:02.328 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-10T09:12:02.400 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-02-10T09:12:02.429 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-02-10T09:12:02.533 INFO:teuthology.run:Summary data: description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} duration: 2939.4633028507233 failure_reason: '"2024-02-10T08:32:45.832632+0000 mon.a (mon.0) 146 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive" in cluster log' owner: scheduled_yuriw@teuthology success: false 2024-02-10T09:12:02.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T09:12:02.611 INFO:teuthology.run:FAIL